Object location system for a road vehicle

• US 20040178945A1
• Filed: 12/22/2003
• Published: 09/16/2004
• Est. Priority Date: 06/23/2001
• Status: Abandoned Application

• Current Assignee: Lucas Industries Limited (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Original Assignee: Lucas Industries Limited (Zeppelin - Stiftung der Stadt Friedrichshafen)
• Inventors: Buchanan, Alastair James
• Application Number:
  US10/744,243
• Publication Number:
  US 20040178945A1
• Time in Patent Office: Days
• US Class Current: 342/70
• CPC Class Codes: B60T 2201/08 Lane monitoring; Lane Keeping Systems
• CPC Class Codes: B60T 2201/089 using optical detection
• CPC Class Codes: G01S 11/12 using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 13/867 Combination of radar systems with cameras
• CPC Class Codes: G01S 13/931 of land vehicles
• CPC Class Codes: G01S 17/86 Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
• CPC Class Codes: G01S 2013/93271 in the front of the vehicles
• CPC Class Codes: G05D 1/0246 using a video camera in combination with image processing means
• CPC Class Codes: G05D 1/0257 using a radar radar systems designed for anti-collision purposes between land vehicles or between land vehicle and fixed obstacles G01S13/931
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

An object location system for identifying the location of objects positioned in front of a host road vehicle (100), comprising: a first sensing means (101) such as a radar or lidar system which transmits a signal and receives reflected portions of the transmitted signal, obstacle detection means (103) adapted to identify the location of obstacles from information from the first sensing means (101); image acquisition means (102) such as a video camera adapted to capture a digital image of at least part of the road ahead of the host vehicle (100); image processing means (103) which processes a search portion of the captured digital image, the search portion including the location of obstacles indicated by the obstacle detection means (103) and being smaller than the captured digital image; and obstacle processing means which determine characteristics of detected obstacles. A method or using such a system is also disclosed.

Claims

1. An object location system for identifying the location of objects positioned in front of a host road vehicle, the system comprising:

a first sensing means including a transmitter adapted to transmit a signal in front of the host vehicle and a detector adapted to detect a portion of the transmitted signal reflected from a target;

an obstacle detection means adapted to identify the location of at least one obstacle or target using information obtained by the first sensing means;

an image acquisition means adapted to capture a digital image of at least a part of the road in front of the host vehicle;

an image processing means adapted to process a search portion of the digital image captured by the image acquisition means which includes the location of the target determined by the obstacle detection means, the area of the search portion being smaller than the area of the captures digital image; and

an obstacle processing means adapted to determine one or more characteristics of the identified target within the search portion of the image from the information contained in the search portion of the image.

2. An object location system according to claim 1 in which the first sensing means comprises a radar or lidar target detection system which employs a time of flight echo location strategy to identify targets within a field of view.

3. An object location system according to claim 1 in which the image acquisition means comprises a digital video camera.

4. An object location system according to claim 1 in which the image processing means includes a digital signal processing circuit and an area of electronic memory in which captured images are stored during analysis.

5. An object location system according to claim 4 in which the image processing means is adapted to identify the edges of any artifacts located within an area of the captured image surrounding the location indicated by the radar system.

6. An object location system according to claim 1 in which the image processing means is adapted to process the information contained within a search portion of the captured image corresponding to a region of the captured image surrounding the location of a probable obstacle.

7. An object location system according to claim 6 in which the search portion is centred on a point from which the sensing means has received a reflection.

8. An object location system according to claim 6 in which the search portion is larger than the expected size of the target.

9. An object location system according to claim 1 in which at least one of the area of the search portion of the image, the width of the search portion of the image, and the height of the search portion of the image is varied as a function of the range of the identified target.

10. An object location system according to claim 1 in which the characteristics determined by the object processing means comprise one or more of:

The type of object-car, lorry, pedestrian,

The width of the object;

The heading of the object;

The lateral position of the object relative to the host vehicle, i.e. its displacement from a projected path of the host vehicle;

The centre point of the object, or of the rear face of the object.

11. An object location system according to claim 10 in which the width of the object is determined by combining the width of the object in the captured image with the range information determined by the first sensing means.

12. An object location system according to claim 1 in which the image processing means employs one or more rules when determining the characteristics of the object.

13. An object location system according to claim 12 in which one such rule is to assume that the object possesses symmetry.

14. An object location system according to claim 1 in which a target image scene is produced corresponding to an image of the portion of the road ahead of the host vehicle in which one or more markers are located, each marker being centred on the location of a source of reflection of the transmitted signal and corresponding to an object identified by the first sensing means.

15. An object location system according to claim 1 in which the image processing means is further adapted to identify any lane markings on the road ahead of the host vehicle from the captured image.

23. A vehicle tracking system which incorporates an object location system according to claim 1.

16. A method of determining one or more characteristics of an object located ahead of a host vehicle, the method comprising:

transmitting a signal in front of the host vehicle and detecting a portion of the transmitted signal reflected from a target;

identifying the location of at least one obstacle ahead of the host vehicle from the reflected signal;

capturing a digital image of at least a part of the road ahead of the host vehicle;

processing a search area of the captured digital image which includes the location of the obstacle identified from the reflected signal, the area processed being smaller than the area of the captured digital image; and

determining one or more characteristics of the identified obstacle from the information contained in the processed image area.

17. The method of claim 16 in which the determined characteristics include the physical width of the object and the type of object identified.

18. The method of claim 16 in which the reflected signal is used to determine the range of the object from the host vehicle and further comprising the step of combining this range information with the width of any identified artifacts in the processed image portion to determine the actual width of the object.

19. The method of claim 16 which further comprises processing a larger area of the captured image for objects that are close to the host vehicle than for objects that are farther away from the host vehicle.

20. The method of claim 16 in which the image portion is processed to identify objects using an edge detection scheme.

21. The method of claim 16 which comprise identifying a plurality of objects located in front of the host vehicle.

22. The method of claim 16 which further comprises detecting the location of lanes on a road ahead of the vehicle and placing the detected object in a lane based upon the lateral location of the vehicle as determined from the processed image.

24. A vehicle tracking system which locates objects according to the method of claim 16.