Object Detection and Tracking System

• US 20100328644A1
• Filed: 11/07/2008
• Published: 12/30/2010
• Est. Priority Date: 11/07/2007
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Higgins-Luthman, Michael J., LU, Yuesheng
• Granted Patent: US 8,027,029 B2
• Time in Patent Office: Days
• US Class Current: 356/5.01
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 2300/8033 for pedestrian protection
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G01C 3/08 Use of electric radiation detectors
• CPC Class Codes: G01S 17/58 Velocity or trajectory determination systems; Sense-of-movement determination systems
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 17/931 of land vehicles
• CPC Class Codes: G01S 7/4802 using analysis of echo signal for target characterisation; Target signature; Target cross-section
• CPC Class Codes: G01S 7/4817 relating to scanning
• CPC Class Codes: G01S 7/4865 Time delay measurement, e.g. time-of-flight measurement, time of arrival measurement or determining the exact position of a peak peak detection in noise, signal conditioning G01S7/487
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 10/147 Details of sensors, e.g. sensor lenses fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 2201/07 Target detection
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/81 : for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An object detection system for a vehicle includes an imaging device, an image processor and a Lidar device. The imaging device is operable to capture image data representative of a scene exterior the vehicle. The image processor processes image data to detect an object of interest in the field of view of the imaging device. The Lidar device is responsive to the image processing so as to have its line of sight guided to point toward the detected object of interest. The Lidar device is operable to measure the distances between the host vehicle and the detected object of interest.

Claims

1. An object detection system for a vehicle, said object detection system comprising:

an imaging device having a field of view exterior of the vehicle and operable to capture image data representative of a scene exterior the vehicle;

an image processor processing image data to detect an object of interest in the field of view of said imaging device; and

a Lidar device responsive to said image processing so as to have its line of sight guided toward the detected object of interest, said Lidar device operable to measure the distances between the host vehicle and the detected object of interest.

2. The object detection system of claim 1, wherein said imaging device comprises a pixelated two-dimensional array of photosensing pixels.

3. The object detection system of claim 1, wherein said Lidar device comprises an illumination source and a detector.

4. The object detection system of claim 3, wherein said Lidar device includes a steering device that steers an aim of said illumination source in response to said image processing.

5. The object detection system of claim 4, wherein said Lidar device is operable to measure the distances via at least one of (i) comparing a modulation phase and (ii) calculating a time of flight of the light between the host vehicle and the detected object.

6. The object detection system of claim 1, wherein said system detects multiple objects of interest in the field of view of said imaging device.

7. The object detection system of claim 6, wherein said system prioritizes the detected objects based on at least one of (i) proximity of the detected objects to the host vehicle, (ii) speed of the detected objects relative to the host vehicle, and (iii) location of the detected objects relative to the host vehicle.

8. The object detection system of claim 7, wherein said system guides said line of sight of said Lidar device toward the detected objects in accordance with the prioritization of the detected objects.

9. The object detection system of claim 8, wherein said system guides said line of sight of said Lidar device toward a first detected object for a first period of time and said system guides said line of sight of said Lidar device toward a second detected object for a second period of time.

10. The object detection system of claim 9, wherein said first detected object has a higher priority than said second detected object and said first period of time is greater than said second period of time.

11. The object detection system of claim 1, wherein said object detection system comprises at least one of (a) an adaptive cruise control system, (b) a collision warning system, (c) a pedestrian detection system, (d) a stop-and-go system, (e) a side object detection system, (f) a lane change aid systems, (g) a side blind zone detection system, (h) a forward object detection system, (i) a rear blind zone object detection system, and (j) a parking assist system.