Warning method and system for detecting lane-changing condition of rear-approaching vehicles

• US 8,903,638 B2
• Filed: 05/24/2012
• Issued: 12/02/2014
• Est. Priority Date: 08/26/2011
• Status: Active Grant

• Current Assignee: Industrial Technology Research Institute
• Original Assignee: Industrial Technology Research Institute
• Inventors: Lin, Che-Chung, Lin, Yu-Chen, Tu, Ming-Jen, Liu, Li-Fen
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): AYNALEM, NATHNAEL B
• Application Number:
  US13/480,070
• Publication Number:
  US 20130050491A1
• Time in Patent Office: 922 Days
• Field of Search: 348/148, 340/425.5, 340/435, 340/461, 340/903, 340/988, 340/438, 340/475, 701/41, 701/28, 701/301, 701/523
• US Class Current: 701/301
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: G06V 10/22 by selection of a specific region containing or referencing a pattern; Locating or processing of specific regions to guide the detection or recognition
• CPC Class Codes: G06V 20/56 exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/0962 having an indicator mounted inside the vehicle, e.g. giving voice messages
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A warning method and system for detecting lane-changing condition of rear-approaching vehicles are disclosed, in which the method comprises the steps of: detecting rear-view images of an ego-vehicle so as to be used for defining three regions of interest (ROI) corresponding respectively to a lane to the left of the ego-vehicle, a lane to the right of the ego-vehicle, and a lane where the ego-vehicle is travelling thereon; detecting whether there is any direction light that is flashing to be used as basis for determining whether there is any vehicle approaching from the rear that is expected to be a potential threat to the ego-vehicle; and if so, issuing an alarm signal to the driver of the ego-vehicle for reminding the same to aware the distance between the ego-vehicle and the rear-approaching vehicle. Thereby, the driver'"'"'s road environment awareness is enhanced and consequently the safety of driving can be improved.

Claims

1. A warning method for detecting lane-changing condition of rear-approaching vehicles, comprising:

performing an image acquisition process for sensing a rear-view image of an ego-vehicle that is performing the warning method;

performing a lane line recognition algorithm for identifying lane lines in the rear-view image and thus obtaining the position information of the lane lines in an image coordinate system;

defining three regions of interest (ROI) corresponding respectively to a lane to the left of the ego-vehicle, a lane to the right of the ego-vehicle, and a lane where the ego-vehicle is travelling thereon, i.e., a left lane ROI, a right lane ROI and an ego-lane ROI, while enabling the three ROIs to be defined based upon the expected height of any common direction light, so as to allow any direction light on a rear-approaching vehicle that is flashing to be recognizable on the acquired rear-view image and thus to be used for determining accurately whether the rear-approaching vehicle is traveling on the same lane of the ego-vehicle or is traveling on the adjacent lane, to the ego-vehicle i.e., the left lane or the right lane;

determining whether there is any direction light flashing in the left lane ROI, indicating that there is a vehicle approaching the ego-vehicle from the left lane of the ego-vehicle, and then determining whether the flashing direction light on the rear-approaching vehicle is the one used for right-turn indication, and if so, performing a warning process for issuing an alarm signal to the driver of the ego-vehicle for reminding the same that the rear-approaching vehicle is going to perform a lane changing maneuver to move from the left lane to the same lane of the ego-vehicle;

determining whether there is any direction light flashing in the right lane ROI, indicating that there is a vehicle approaching the ego-vehicle from the right lane of the ego-vehicle, and then determining whether the flashing direction light on the rear-approaching vehicle is the one used for left-turn indication, and if so, performing the warning process for issuing an alarm signal to the driver of the ego-vehicle for reminding the same that the rear-approaching vehicle is going to perform a lane changing maneuver to move from the right lane to the same lane of the ego-vehicle; and

determining whether there is any direction light flashing in the ego-lane ROI, indicating that there is a vehicle approaching the ego-vehicle from the rear in the same lane of the ego-vehicle, and then determining whether the flashing direction light on the rear-approaching vehicle is the one used for right-turn indication, and if so, performing the warning process for issuing an alarm signal to the driver of the ego-vehicle for reminding the same that the rear-approaching vehicle is going to perform a lane changing maneuver to move from the ego-lane to the right lane of the ego-vehicle;

otherwise, determining whether the flashing direction light on the rear-approaching vehicle is the one used for left-turn indication, and if so, performing the warning process for issuing an alarm signal to the driver of the ego-vehicle for reminding the same that the rear-approaching vehicle is going to perform a lane changing maneuver to move from the ego-lane to the left lane of the ego-vehicle.

2. The warning method of claim 1, wherein the image acquisition process is executed using at least one image sensor that is mounted on the rear of the ego-vehicle at a specific position;

and then at least one image sensor is designed to be activated along with the activation of a signal processing and control module, a display unit and an alarm unit the minute when the ego-vehicle is shifted into a forward gear and starts moving.

3. The warning method of claim 1, wherein during the performing of the image acquisition process, the rear-view image of the ego-vehicle is acquired using an image sensor and then the image sensor is enabled to transmit the acquired rear-view image to a signal processing and control module.

4. The warning method of claim 1, wherein in the performing of the lane line recognition algorithm, a signal processing and control module is used for processing the rear-view image using a Sobel filter so as to identify edges of lane lines that are to be used in a Hough transform operation for obtaining position information of the lane lines in the image coordinate system.

5. The warning method of claim 4, wherein the image coordinate system is a coordinate system which is used to uniquely determine the position of a point or other geometric elements of the rear-view image that is acquired by the image sensor and displayed on the displaying area of a display unit.

6. The warning method of claim 1, wherein the defining of the three ROIs is performed in a means comprising:

using a technique of inverse perspective projection with reference to the expected height of any common direction light for obtaining expected positions of direction lights on a vehicle approaching from the right lane in a vehicle coordinate system, expected positions of direction lights on a vehicle approaching from the left lane in the vehicle coordinate system, and expected positions of direction lights on a vehicle approaching from the ego-lane in the vehicle coordinate system; and

then using a technique of perspective projection with reference to the positions of the identified lane lines and the expected height of any common direction light to determine the adaptive lane lines which is defined in the image coordinate system for obtaining the left lane ROI, the right lane ROI and the ego-lane ROI.

7. The warning method of claim 6, wherein the vehicle coordinate system is a coordinate system which is used to uniquely determine the position of a point or other geometric elements in a space including the position of the ego-vehicle and those other positions in the rear of the ego-vehicle.

8. The warning method of claim 6, wherein in the defining of the three ROIs, the lines separating the three ROIs are not actual lane lines detected in the rear-view image, but are adaptive lane lines.

9. The warning method of claim 6, wherein the defining of the three ROIs is performed in a means comprising:

with reference to the positions (x_i, y_i) of the lane lines detected in the image coordinate system, using the following inverse perspective projection equations;

10. The warning method of claim 4, wherein during the performing of the lane line recognition algorithm, a signal processing and control module is used for processing the rear-view image so as to obtain the position information of the lane lines in the image coordinate system.

11. The warning method of claim 1, wherein in the determining whether there is any direction light flashing in the left lane ROI, in the right lane ROI and in the ego-lane ROI, a image sensor is used for detecting whether any of the direction lights of a vehicle approaching from the rear of the ego-vehicle is flashing.

12. The warning method of claim 1, wherein in the determining whether there is any direction light flashing in the left lane ROI, in the right lane ROI and in the ego-lane ROI, an alarm unit is used for issuing the corresponding alarm signal.

13. A warning system for detecting lane-changing condition of rear-approaching vehicles, comprising:

a signal process-control module comprising;

an image acquisition and decoding unit , a random access memory, an image coding and outputting unit, a signal processing and control unit, and a non-volatile programmable memory;

an image sensor, electrically connected to the signal process-control module;

a control unit, electrically connected to the signal process-control module;

a display unit, electrically connected to the signal process-control module; and

an alarm unit, electrically connected to the signal process-control module;

wherein the signal process-control module is used for processing the rear-view image from the image sensor using a Sobel filter so as to identify edges of lanes that are to be used in a Hough transform operation for obtaining position information of the lane lines in the image coordinate system; and

further, with reference to the positions (x_i,y_i) of the lane lines detected in the image coordinate system, the signal process-control modules uses the following inverse perspective projection equations;

14. The warning system of claim 13, wherein the image sensor is an optical sensing device selected from the group consisting of:

an infrared image capturing device, a charge coupled device (CCD) and a complementary metal oxide semiconductor (CMOS).

15. The warning system of claim 13, wherein the image sensor is electrically connected to the signal process-control module through a transmission interface, and the transmission interface is an interface selected from the group consisting of:

an analog interface and a digital interface.

16. The warning system of claim 15, wherein the transmission interface is an interface selected from the group consisting of:

an analog composite video interface, and a digital low-voltage differential signal (LVDS) interface.

17. The warning system of claim 13, wherein an alarm signal generated by the alarm unit is a signal selected from the group consisting of:

a sound signal, a light signal, a vibration signal and the combinations thereof.

18. The warning system of claim 13, wherein the signal process-control module further comprises:

a Sobel filter, and is equipped with the abilities of Hough transform operation and logical decision operation.

19. The warning system of claim 13, wherein the control unit is used for activating the image sensor, the signal process-control module, the display unit and the alarm unit;

the image acquisition and decoding unit is used for converting images that are captured by the image sensor into digital data capable of being processed by the signal processing and control unit;

the random access memory is used for storing digital data transmitted from the signal processing and control unit;

the image coding and outputting unit is used for receiving and coding data from the random access memory into image data while outputting the same to the display unit for displaying; and

the non-volatile programmable memory is used for storing the image data, a data for configuration, and a data for updating.