Event recording system for a vehicle

• US 10,308,181 B2
• Filed: 10/25/2017
• Issued: 06/04/2019
• Est. Priority Date: 08/20/2012
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Nix, Axel
• Primary Examiner(s): Wong, Allen C
• Application Number:
  US15/793,134
• Publication Number:
  US 20180086267A1
• Time in Patent Office: 587 Days
• Field of Search: 348148
• CPC Class Codes: B60R 1/002 specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like integrated in the windows B60R1/001; combined with rear-view mirrors B60R1/08
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: B60W 10/18 including control of braking systems
• CPC Class Codes: B60W 10/20 including control of steering systems
• CPC Class Codes: B60W 2050/143 Alarm means
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2554/80 Spatial relation or speed relative to objects
• CPC Class Codes: B60W 2710/18 Braking system
• CPC Class Codes: B60W 2710/20 Steering systems
• CPC Class Codes: B60W 30/09 Taking automatic action to avoid collision, e.g. braking and steering
• CPC Class Codes: B60W 30/095 Predicting travel path or likelihood of collision
• CPC Class Codes: B60W 50/0098 Details of control systems ensuring comfort, safety or stability not otherwise provided for
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

A vehicular event recording system suitable includes a camera and an event recorder having memory. An image processor processes image data captured by the camera for detecting objects. Based at least in part on processing by the image processor of captured image data, a potential lane leaving event or potential collision event or automatic braking event is determined. The event recorder receives vehicle data via a vehicle data bus of the vehicle. Captured image data and received vehicle data during a pre-event time period immediately preceding the determined event beginning is stored in memory of the event recorder. Captured image data and received vehicle data during a first post-event time period immediately following the determined event beginning is stored in memory of the event recorder.

Claims

1. An event recording system suitable for use in a vehicle, said event recording system comprising:

a forward-viewing camera mounted at a front windshield of a vehicle equipped with said event recording system;

said camera viewing forward of the equipped vehicle through the windshield;

said camera comprising a lens and an image sensor;

said image sensor comprising a plurality of photosensor elements arranged in a photosensor array having rows and columns;

an event recorder comprising memory;

an image processor;

wherein said image processor is operable to process image data captured by said camera for detecting objects in the field of view of said camera;

said image processor utilizing object detection software for detecting objects in the field of view of said camera;

wherein memory of said event recorder comprises random access memory;

wherein memory of said event recorder comprises non-volatile memory;

wherein, based at least in part on processing by said image processor of image data captured by said camera, a potential lane leaving event is determined;

wherein said potential lane leaving event comprises at least one of (i) when the equipped vehicle is heading towards a lane marking and (ii) when the equipped vehicle is within a certain distance of an edge of a lane marking;

wherein, based at least in part on processing by said image processor of image data captured by said camera, a potential collision event is determined;

wherein said potential collision event comprises the equipped vehicle heading towards an object present ahead of the equipped vehicle with the separation between the equipped vehicle and the object being less than a threshold;

wherein said event recorder receives vehicle data via a vehicle data bus of the equipped vehicle;

wherein vehicle data received at said event recorder comprises vehicle speed;

wherein image data captured by said camera and vehicle data received at said event recorder during a first pre-event time period immediately preceding said potential lane leaving event beginning is stored in memory of said event recorder;

wherein image data captured by said camera and vehicle data received at said event recorder during a first post-event time period immediately following said potential lane leaving event beginning is stored in memory of said event recorder;

wherein image data captured by said camera and vehicle data received at said event recorder during a second pre-event time period immediately preceding said potential collision event beginning is stored in memory of said event recorder; and

wherein image data captured by said camera and vehicle data received at said event recorder during a second post-event time period immediately following said potential collision event beginning is stored in memory of said event recorder.

2. The event recording system of claim 1, wherein image data is stored in random access memory of said event recorder responsive to at least one of (i) image processing by said image processor and (ii) vehicle data received at said event recorder.

3. The event recording system of claim 2, wherein image data is moved from random access memory to non-volatile memory based on a priority determination.

4. The event recording system of claim 1, wherein captured image data is processed to detect at least one probability event.

5. The event recording system of claim 4, wherein said event recording system is operable to determine if a detected probability event is true or false.

6. The event recording system of claim 5, wherein the determination comprises detection of driver response to the probability event.

7. The event recording system of claim 6, wherein driver response to the probability event is represented by vehicle data received at said event recorder indicating at least one of a brake activation, a steering wheel movement, a yaw rate change, a vehicle deceleration and a vehicle acceleration.

8. The event recording system of claim 1, wherein at least one of said first and second pre-event time periods is greater than zero seconds and less than six seconds.

9. The event recording system of claim 1, wherein at least one of said first and second post-event time periods is greater than zero seconds and less than four seconds.

10. The event recording system of claim 1, wherein vehicle data received at said event recorder comprises at least one of (i) brake deployment data, (ii) airbag deployment data and (iii) anti-lock braking system (ABS) deployment data.

11. An event recording system suitable for use in a vehicle, said event recording system comprising:

a forward-viewing camera mounted at a front windshield of a vehicle equipped with said event recording system;

said camera viewing forward of the equipped vehicle through the windshield;

said camera comprising a lens and an image sensor;

said image sensor comprising a plurality of photosensor elements arranged in a photosensor array having rows and columns;

an event recorder comprising memory;

an image processor;

wherein said image processor is operable to process image data captured by said camera for detecting objects in the field of view of said camera;

said image processor utilizing object detection software for detecting objects in the field of view of said camera;

wherein memory of said event recorder comprises random access memory;

wherein memory of said event recorder comprises non-volatile memory;

wherein image data is moved from random access memory to non-volatile memory

wherein, based at least in part on processing by said image processor of image data captured by said camera, a potential collision event is determined;

wherein said event recorder receives vehicle data via a vehicle data bus of the equipped vehicle;

wherein vehicle data received at said event recorder is indicative of at least one of (i) brake activation, (ii) steering wheel movement, (iii) yaw rate change, (iv) vehicle deceleration and (v) vehicle acceleration;

wherein image data captured by said camera and vehicle data received at said event recorder during a pre-event time period immediately preceding said potential collision event beginning is stored in memory of said event recorder; and

wherein image data captured by said camera and vehicle data received at said event recorder during post-event time period immediately following said potential collision event beginning is stored in memory of said event recorder.

12. The event recording system of claim 11, wherein said post-event time period is greater than zero seconds and less than four seconds.

13. The event recording system of claim 11, wherein said pre-event time period is greater than zero seconds and less than six seconds.

14. The event recording system of claim 13, wherein vehicle data received at said event recorder comprises at least one of (i) brake deployment data, (ii) airbag deployment data and (iii) anti-lock braking system (ABS) deployment data.

15. The event recording system of claim 14, wherein captured image data is processed to detect at least one probability event, and wherein said event recording system is operable to determine if a detected probability event is true or false, and wherein the determination comprises detection of driver response to the probability event, and wherein driver response to the probability event is represented by vehicle data received at said event recorder indicating at least one of (i) brake activation, (ii) steering wheel movement, (iii) yaw rate change, (iv) vehicle deceleration and (v) vehicle acceleration.

16. The event recording system of claim 11, wherein image data is stored in random access memory of said event recorder responsive to at least one of (i) image processing by said image processor and (ii) vehicle data received at said event recorder, and wherein image data is moved from random access memory to non-volatile memory based on a priority determination.

17. An event recording system suitable for use in a vehicle, said event recording system comprising:

a forward-viewing camera mounted at a front windshield of a vehicle equipped with said event recording system;

said camera viewing forward of the equipped vehicle through the windshield;

said camera comprising a lens and an image sensor;

said image sensor comprising a plurality of photosensor elements arranged in a photosensor array having rows and columns;

an event recorder comprising memory;

an image processor;

wherein said image processor is operable to process image data captured by said camera for detecting objects in the field of view of said camera;

said image processor utilizing object detection software for detecting objects in the field of view of said camera;

wherein memory of said event recorder comprises random access memory;

wherein memory of said event recorder comprises non-volatile memory;

wherein, based at least in part on processing by said image processor of image data captured by said camera, an automatic braking event is determined;

wherein said event recorder receives vehicle data via a vehicle data bus of the equipped vehicle;

wherein image data captured by said camera and vehicle data received at said event recorder during a pre-event time period immediately preceding said automatic braking event beginning is stored in memory of said event recorder; and

wherein image data captured by said camera and vehicle data received at said event recorder during post-event time period immediately following said automatic braking event beginning is stored in memory of said event recorder.

18. The event recording system of claim 17, wherein said event recording system is operable to determine if a detected probability event is true or false, and wherein the determination comprises detection of driver response to the probability event, and wherein driver response to the probability event is represented by vehicle data received at said event recorder indicating at least one of a brake activation, a steering wheel movement, a yaw rate change, a vehicle deceleration and a vehicle acceleration.

19. The event recording system of claim 17, wherein image data is stored in random access memory of said event recorder.

20. The event recording system of claim 19, wherein image data is stored in random access memory of said event recorder responsive to at least one of (i) image processing by said image processor and (ii) vehicle data received at said event recorder.

21. The event recording system of claim 19, wherein image data is moved from random access memory to non-volatile memory.

22. The event recording system of claim 19, wherein said post-event time period is greater than zero seconds and less than four seconds.

23. The event recording system of claim 19, wherein said pre-event time period is greater than zero seconds and less than six seconds.

24. The event recording system of claim 19, wherein vehicle data received at said event recorder comprises at least one of (i) brake deployment data, (ii) airbag deployment data and (iii) anti-lock braking system (ABS) deployment data.