Safety system for a vehicle to detect and warn of a potential collision

• US 10,127,464 B2
• Filed: 05/18/2016
• Issued: 11/13/2018
• Est. Priority Date: 05/18/2015
• Status: Active Grant

• Current Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Original Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Inventors: Elimalech, Yaniv, Stein, Gideon
• Primary Examiner(s): Nguyen, Huy T
• Application Number:
  US15/158,294
• Publication Number:
  US 20160342850A1
• Time in Patent Office: 909 Days
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/582 of traffic signs
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/0112 from the vehicle, e.g. floating car data [FCD]
• CPC Class Codes: G08G 1/0133 for classifying traffic situation
• CPC Class Codes: G08G 1/0141 for traffic information dissemination
• CPC Class Codes: G08G 1/0969 having a display in the form of a map
• CPC Class Codes: G08G 1/161 Decentralised systems, e.g. inter-vehicle communication
• CPC Class Codes: G08G 1/163 involving continuous checking
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A system mountable in a vehicle to provide object detection in the vicinity of the vehicle. The system includes a camera operatively attached to a processor. The camera is mounted externally at the rear of the vehicle. The field of view of the camera is substantially in the forward direction of travel of the vehicle along the side of the vehicle. Multiple image frames are captured from the camera. Yaw of the vehicle may be input or the yaw may be computed from the image frames. Respective portions of the image frames are selected responsive to the yaw of the vehicle. The image frames are processed to detect thereby an object in the selected portions of the image frames.

Claims

1. A method performed by a system mountable in a vehicle to provide object detection in the vicinity of the vehicle, the system including a camera operatively attached to a processor, wherein the camera is mounted externally at the rear of the vehicle, wherein the field of view of the camera is substantially in the forward direction of travel of the vehicle along a side of the vehicle, the method comprising:

capturing a plurality of image frames with the camera;

determining a yaw rate of the vehicle using a yaw sensor;

selecting respective portions of the image frames based on an analysis of collected data indicative of a potential blind spot and based on the yaw rate of the vehicle; and

processing the selected respective portions of the image frames to detect an obstruction.

2. The method of claim 1, the method further comprising:

upon measuring an increase in absolute value of the yaw, processing a larger area of the image frames thereby increasing an effective horizontal field of view to detect an obstruction over a wider horizontal angle measured from the left side of the vehicle.

3. The method of claim 1, wherein the camera is installed externally on the right side of the vehicle, the method further comprising:

upon the vehicle turning right, processing a larger area of the image frames thereby increasing an effective horizontal field of view to detect an obstruction over a wider horizontal angle measured from the right side of the vehicle.

4. The method of claim 1, wherein the camera is installed externally on the left side of the vehicle, the method further comprising:

upon the vehicle turning left, processing a larger area of the image frames thereby increasing an effective horizontal field of view to detect an obstruction over a wider horizontal angle measured from the left side of the vehicle.

5. The method of claim 1, further comprising:

determining said object is a moving obstacle;

verifying that said object will be in a projected path of the vehicle thereby determining a potential collision of said vehicle with said moving obstacle; and

warning a driver of said vehicle of said potential collision with said moving obstacle.

6. The method of claim 5, wherein said warning is selected from the group consisting of:

sounding an audible warning and a displaying a visible warning.

7. The method of claim 6, further comprising:

issuing said warning from the side of the vehicle on which is mounted the camera viewing the moving obstacle.

8. The method of claim 1, wherein said object is selected from a group of objects consisting:

a bicyclist, a motorcyclist, a vehicle, a pedestrian, a child riding on a toy vehicle, a person with pram and a wheelchair user.

9. The method of claim 1, further comprising:

using another driver assistance system selected from the group consisting of;

lane detection, structural barrier recognition, traffic sign recognition to recognize a stationary object; and

enabling suppression of a warning to the driver if all objects detected in the immediate vicinity of the vehicle are stationary objects.

10. A system mountable in a vehicle to provide object detection in the vicinity of the vehicle, the system including a camera operatively attached to a processor, wherein the camera is mounted externally at the rear of the vehicle, wherein the field of view of the camera is substantially in the forward direction of travel of the vehicle along a side of the vehicle;

the system operable to;

capture a plurality of image frames with the camera;

determine a yaw rate of the vehicle using a yaw sensor;

select respective portions of the image frames based on an analysis of collected data indicative of a potential blind spot and based on the yaw rate of the vehicle;

process the selected respective portions of the image frames to detect an obstruction; and

detect an object imaged in the selected portions of the image frames.

11. The system of claim 10, further operable to:

upon measuring an increase in absolute value of the yaw, process a larger area of the image frames to increase an effective horizontal field of view and to detect thereby an obstruction over a wider horizontal angle measured from the side of the vehicle.

12. The system of claim 10, wherein the camera is installed on the right side of the vehicle, the method further operable to:

when the vehicle turns right, process a larger area of the image frames to increase an effective horizontal field of view to detect thereby an obstruction over a wider horizontal angle measured from the right side of the vehicle.

13. The system of claim 10, wherein the camera is installed on the left side of the vehicle, the method further operable to:

when the vehicle turns left, process a larger area of the image frames to increase an effective horizontal field of view and to detect thereby an obstruction over a wider horizontal angle measured from the left side of the vehicle.

14. The system of claim 10, further operable to:

determine said object is a moving obstacle;

verify that said object will be in a projected path of the vehicle thereby determining a potential collision of said vehicle with said moving obstacle; and

warn a driver of said vehicle of said potential collision with said moving obstacle.

15. The system of claim 14, wherein said warning is selected from the group consisting of:

sounding an audible warning and a displaying a visible warning.

16. The system of claim 15, further operable to:

issue said warning from the side of the vehicle on which is mounted the camera viewing the moving obstacle.

17. The system of claim 10, wherein said object is selected from a group of objects consisting:

a bicyclist, a motorcyclist, a vehicle, a pedestrian, a child riding on a toy vehicle, a person with pram and a wheelchair user.

18. The system of claim 10, further operable to:

using another driver assistance system selected from the group consisting of;

lane detection, structural barrier recognition, traffic sign recognition to recognize a stationary object; and

suppress a warning to the driver if all objects detected in the immediate vicinity of the vehicle are stationary objects.