Vehicle visual and non-visual data recording system

• US 9,947,152 B2
• Filed: 07/18/2011
• Issued: 04/17/2018
• Est. Priority Date: 01/25/2002
• Status: Expired due to Term

• Current Assignee: Appy Risk Technologies Limited (Trak Global Group Ltd.)
• Original Assignee: Intelligent Mechatronic Systems Inc. (Trak Global Group Ltd.)
• Inventors: Basir, Otman A., Karray, Fakhreddine, Desrochers, Kristopher, Bhavnani, Jean-Pierre, Bullock, David, Rahim, Inam
• Primary Examiner(s): Black, Thomas G
• Assistant Examiner(s): Nolan, Peter D
• Application Number:
  US13/185,005
• Publication Number:
  US 20110295446A1
• Time in Patent Office: 2,465 Days
• Field of Search: 701 322, 701 323, 701 334, 340439
• CPC Class Codes: B60W 2540/30 Driving style
• CPC Class Codes: G07C 5/085 using electronic data carriers
• CPC Class Codes: G07C 5/0866 the electronic data carrier being a digital video recorder in combination with video camera
• CPC Class Codes: G07C 5/0891 Video recorder in combination with video camera

Abstract

The system described in this invention can be used for monitoring and analyzing real time visual and non-visual information pertaining to the occupant, vehicle, and surroundings prior to, during and post eccentric operating conditions for a given period of time. The system stores vehicle and occupant data from sensors throughout the vehicle and also makes use of existing vehicle sensors that may already be present in the vehicle. The invention also includes a video recording module that makes use of a fish-eye camera to capture video from the inside and the outside of the vehicle. Real-time data analysis is performed to detect and to recognize vehicle occupants, and recognize impending eccentric events. Vehicle, occupant, and video data are stored in circular buffers. When an eccentric event, a collision for example, has been detected, the device continues to record data and video for a fixed period of time. Once this time has elapsed, the data is transferred from volatile to non-volatile memory for later retrieval. A computer may be used to retrieve and display the vehicle and occupant data in a synchronization with the video data for the purposes of accident recreation, driver or vehicle monitoring.

Claims

1. An in-vehicle recording system comprising:

a plurality of occupant sensors in the vehicle capturing occupant data, wherein the occupant sensors gather biometric data regarding the at least one occupant in the vehicle, wherein the occupant sensors are capable of determining a size of at least one occupant in the vehicle, wherein the occupant data includes occupant size including height or weight;

a video capture module recording video data inside and outside the vehicle;

a data recorder in the vehicle, the data recorder recording the occupant data and the video data and synchronizing the occupant data with the video data, wherein the data recorder records the size of the at least one occupant in the vehicle, wherein the occupant sensors are configured to report the biometric data to the data recorder;

a control unit transmitting the recorded video data and the occupant data wirelessly to a central server; and

a display in the vehicle configured to display video data recorded by the data recorder, wherein the display is configured to display the video data and the occupant data from the occupant sensors, and wherein the occupant data from the occupant sensors is synchronized with the video data on the display.

2. The in-vehicle recording system of claim 1, wherein the occupant sensors determine the number of occupants in the vehicle and report the number of occupants in the vehicle to the data recorder.

3. The in-vehicle recording system of claim 1, wherein the occupant sensors determine positions of occupants in the vehicle and report the positions of the occupants in the vehicle to the data recorder.

4. The in-vehicle recording system of claim 1, wherein the occupant sensors determine a drowsiness level of the at least one occupant in the vehicle and report the drowsiness level to the data recorder.

5. The in-vehicle recording system of claim 1, wherein the occupant data and the video data are continuously synchronized by the data recorder.

6. The in-vehicle recording system of claim 1, wherein the video capture module comprises a wide-angle lens.

7. The in-vehicle recording system of claim 6, wherein the lens is a fisheye lens.

8. The in-vehicle recording system of claim 1, wherein the video capture module comprises a digital video camera.

9. The in-vehicle recording system of claim 8, further comprising a video processor for processing the video data.

10. The in-vehicle recording system of claim 1 wherein the occupant data includes height and weight.

11. A method for monitoring a vehicle including the steps of:

capturing vehicle data;

recording the vehicle data;

determining a vehicle location;

displaying the vehicle data and displaying the vehicle location on a display in the vehicle;

displaying navigation instructions based upon the vehicle location, wherein the vehicle data includes vehicle lifetime use data, wherein the vehicle lifetime use data is based upon occurrences of unsafe driving conditions.

12. The method of claim 11 wherein the vehicle lifetime use data is based upon a number of times that the speed of the vehicle exceeded a threshold.

13. An in-vehicle recording system comprising:

a plurality of occupant sensors in the vehicle capturing occupant data, wherein the occupant sensors gather biometric data regarding the at least one occupant in the vehicle, wherein the occupant sensors are capable of determining a size of at least one occupant in the vehicle, wherein the occupant data includes occupant size;

a video capture module recording video data inside and outside the vehicle;

a data recorder in the vehicle, the data recorder recording the occupant data and the video data and synchronizing the occupant data with the video data, wherein the occupant sensors report the biometric data to the data recorder, wherein the data recorder records the size of the at least one occupant in the vehicle;

a control unit transmitting the recorded video data and the occupant data wirelessly to a central server; and

a display displaying video data recorded by the data recorder, wherein the display displays the video data and the occupant data from the occupant sensors, and wherein the occupant data from the occupant sensors is synchronized with the video data on the display.

14. The in-vehicle recording system of claim 13, wherein the occupant sensors determine a drowsiness level of the at least one occupant in the vehicle and report the drowsiness level to the data recorder.

15. The in-vehicle recording system of claim 13 wherein the occupant sensors determine the number of occupants in the vehicle and report the number of occupants in the vehicle to the data recorder.

16. The in-vehicle recording system of claim 13, wherein the occupant sensors determine positions of occupants in the vehicle and report the positions of the occupants in the vehicle to the data recorder.

17. The in-vehicle recording system of claim 13, wherein the occupant sensors determine a drowsiness level of the at least one occupant in the vehicle and report the drowsiness level to the data recorder.

18. A method for monitoring a vehicle including the steps of:

capturing vehicle data;

recording the vehicle data;

determining a vehicle location;

displaying the vehicle data on a display in the vehicle wherein the vehicle data includes historical occurrences of the speed of the vehicle exceeding a threshold;

displaying the vehicle location on the display in the vehicle; and

displaying navigation instructions on the display based upon the vehicle location.

19. The method of claim 18 wherein the vehicle data may be retrieved and displayed for a selected previous period of time.