AUGMENTED OBJECT DETECTION USING STRUCTURED LIGHT

• US 20170236014A1
• Filed: 11/05/2015
• Published: 08/17/2017
• Est. Priority Date: 11/05/2014
• Status: Active Grant

• Current Assignee: TRW Automotive USLLC (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Original Assignee: TRW Automotive USLLC (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Inventors: Schamp, Gregory G.
• Granted Patent: US 10,181,085 B2
• Time in Patent Office: Days
• CPC Class Codes: B60R 1/002 specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like integrated in the windows B60R1/001; combined with rear-view mirrors B60R1/08
• CPC Class Codes: B60R 2300/202 displaying a blind spot scene on the vehicle part responsible for the blind spot
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: G01B 11/026 by measuring distance between sensor and object G01B11/0608 takes precedence
• CPC Class Codes: G01B 11/14 for measuring distance or clearance between spaced objects or spaced apertures G01B11/26 takes precedence; rangefinders G01C3/00
• CPC Class Codes: G01C 11/025 by scanning the object
• CPC Class Codes: G01S 17/46 Indirect determination of position data
• CPC Class Codes: G01S 17/931 of land vehicles
• CPC Class Codes: G01V 8/10 Detecting, e.g. by using light barriers by reflection from the object G01S17/00
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Systems and methods are provided for imaging a region of interest. A structured light source is configured to provide a substantially two-dimensional light curtain within a field of view of the camera formed by at least one projected laser beam at a wavelength detectable by the camera. An image analysis component is configured to detect objects within the region of interest from at least a position of the at least one projected laser beam within the image.

Claims

1. An object detection system for detecting objects within a region of interest, comprising:

a camera configured to image a region of interest;

a structured light source configured to provide a substantially two-dimensional light curtain within a field of view of the camera formed by at least one projected laser beam at a wavelength detectable by the camera; and

an image analysis component configured to detect objects within the region of interest from at least a position of the at least one projected laser beam within the image.

2. The object detection system of claim 1, wherein the structured light source comprises a laser diode and a beam shaping optical component configured to produce the substantially two-dimensional light curtain.

3. The object detection system of claim 2, the laser diode being configured as to produce light within the infrared band.

4. The object detection system of claim 1, wherein the camera is mounted to a vehicle at a first location and the structured light source is mounted to the vehicle at a second location, spatially remote from the first location.

5. The object detection system of claim 1, wherein the image analysis system is configured to evaluate an intersection of the substantially two-dimensional light curtain with the ground within the image, with the presence of an object being indicated by a deviation of a line formed by the intersection from an expected baseline.

6. The object detection system of claim 1, wherein the substantially two-dimensional light curtain is a first substantially two-dimensional light curtain, the structured light source being further configured to provide a second substantially two-dimensional light curtain within the field of view of the camera, the second substantially two-dimensional light curtain being substantially parallel to the first substantially two-dimensional light curtain.

7. The object detection system of claim 5, wherein the image analysis component is configured to evaluate respective intersections of each of the first substantially two-dimensional light curtain and the second substantially two-dimensional light curtain with the ground within the image, with the presence of an object at a first distance being indicated by a deviation of a line formed by the intersection of the first substantially two-dimensional light curtain and the ground from a first expected baseline and the presence of an object at a second distance being indicated by a deviation of a line formed by the intersection of the second substantially two-dimensional light curtain and the ground from a second expected baseline.

8. The object detection system of claim 1, wherein the substantially two-dimensional light curtain is a first substantially two-dimensional light curtain, the structured light source being further configured to provide a second substantially two-dimensional light curtain within the field of view of the camera, the second substantially two-dimensional light curtain being substantially perpendicular to the first substantially two-dimensional light curtain.

9. The object detection system of claim 1, wherein the structured light source is configured to have a dispersion angle between forty degrees and fifty degrees.

10. The object detection system of claim 1, the image analysis component comprising a coordinate transform component configured to apply a coordinate transform to the image, such that for each pixel (x, y) within the image, where x represents a column in which the pixel is located and y is a row in which the pixel is located, a position (X, Z), where X represents a distance cross range of the camera and Z represents a distance downrange of the camera, is determined as

11. The object detection system of claim 1, the object detection system comprising an elevation calculation component configured to determine an elevation, Y, at a given location from its distance, Z, downrange of the camera and a row, y, in which the pixel representing the location is located as

12. A method for detecting objects within a region of interest, comprising:

projecting a substantially two-dimensional light curtain into a region of interest;

imaging the region of interest at a camera to provide an image, such that an intersection of the substantially two-dimensional light curtain with the ground is visible; and

determining that an object is present if the intersection of the substantially two-dimensional light curtain with the ground deviates from an expected baseline.

13. The method of claim 12, wherein projecting the substantially two-dimensional light curtain into the region of interest comprises projecting a first substantially two-dimensional light curtain and a second substantially two-dimensional light curtain into the region of interest, with the second substantially two-dimensional light curtain being substantially parallel to the first substantially two-dimensional light curtain.

14. The method of claim 13, wherein determining that the object is present comprising determining the presence of the object at a first distance if a line formed by the intersection of the first substantially two-dimensional light curtain and the ground deviates from a first expected baseline and determining the presence of an object at a second distance if a line formed by the intersection of the second substantially two-dimensional light curtain and the ground deviates from a second expected baseline.

15. The method of claim 12, wherein projecting the substantially two-dimensional light curtain into the region of interest comprises projecting a first substantially two-dimensional light curtain and a second substantially two-dimensional light curtain into the field of view of the camera, the second substantially two-dimensional light curtain being substantially perpendicular to the first substantially two-dimensional light curtain.

16. The method of claim 15, further comprising applying a coordinate transform to the image, such that for each pixel (x, y) within the image, where x represents a column in which the pixel is located and y is a row in which the pixel is located, a position (X, Z), where X represents a distance cross range of the camera and Z represents a distance downrange of the camera, is determined as

17. The method of claim 16, further comprising determining an elevation, Y, at a given location from its distance, Z, downrange of the camera and a row, y, in which the pixel representing the location is located as

18. An object detection system for detecting objects within one of a blind spot and a region rearward of a vehicle, comprising:

a camera configured to image the one of the blind spot and the region rearward of the vehicle;

a structured light source, comprising a laser diode and a beam shaping optical component, configured to provide a substantially two-dimensional light curtain within a field of view of the camera formed by at least one projected laser beam at a wavelength detectable by the camera; and

an image analysis component configured to detect objects within the one of the blind spot and the region rearward of the vehicle from at least a position of the at least one projected laser beam within the image.

19. The object detection system of claim 18, wherein the camera is mounted to a vehicle at a first location and the structured light source is mounted to the vehicle at a second location, spatially remote from the first location.

20. The object detection system of claim 18, wherein the image analysis system is configured to evaluate an intersection of the substantially two-dimensional light curtain with the ground within the image, with the presence of an object being indicated by a deviation of a line formed by the intersection from an expected baseline.