Memory management in event recording systems

• US 9,911,253 B2
• Filed: 12/28/2015
• Issued: 03/06/2018
• Est. Priority Date: 12/08/2005
• Status: Active Grant

• Current Assignee: SmartDrive Systems, Inc. (Solera Holdings Incorporated)
• Original Assignee: SmartDrive Systems, Inc. (Solera Holdings Incorporated)
• Inventors: Plante, James
• Primary Examiner(s): Tran, Khoi H
• Assistant Examiner(s): Peche, Jorge O
• Application Number:
  US14/981,384
• Publication Number:
  US 20160117872A1
• Time in Patent Office: 799 Days
• Field of Search: 701 322, 701 333, 701 334, 711147, 711 5, 345545, 345546, 345547, 345531-538, 710 56, 710 53, 375372, 348567, 3482311
• CPC Class Codes: G07C 5/02 Registering or indicating driving, working, idle, or waiting time only apparatus forming part of taximeters G07B13/00
• CPC Class Codes: G07C 5/0866 the electronic data carrier being a digital video recorder in combination with video camera
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/41422 located in transportation means, e.g. personal vehicle arrangements specially adapted for transportation systems in broadcast systems H04H20/62
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/42692 for reading from or writing on a volatile storage medium, e.g. Random Access Memory [RAM]
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44 Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/440281 by altering the temporal resolution, e.g. by frame skipping television signal recording using magnetic recording on tape for reproducing at a rate different from the recording rate H04N5/783
• CPC Class Codes: H04N 21/4435 Memory management allocation of memory to service a request G06F9/5016; addressing or allocating within memory systems or architectures G06F12/02
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A vehicle event recorder is provided that includes a camera for capturing a video as discrete image frames, and that further includes a managed loop memory and a management system for generating a virtual ‘timeline dilation’ effect. To overcome size limits in the buffer memory of the video event recorder, the maximum time extension of a video series is increased by enabling a reduction in temporal resolution in exchange for an increase in the temporal extension. Memory cells are overwritten in an ‘interleaved’ fashion to produce a reduced frame rate for the recording of certain time periods connected to an event moment. In time periods furthest from the event moment, the resulting frame rate is minimized while in time periods closest to the event moment, the resulting frame rate is maximized.

Claims

1. A vehicle event recorder system configured to be mounted in a vehicle, the vehicle event recorder system comprising:

a camera configured to capture image data, wherein the camera has a field-of-view that includes an environment in and/or around the vehicle, wherein the image data includes a set of consecutive frames of visual information;

a buffer memory configured to electronically store information, wherein the information includes the image data;

a long-term storage memory configured to store information, wherein the stored information includes a subset of the set of consecutive frames of visual information;

one or more sensors configured to generate output signals conveying vehicle information related to a particular vehicle event at a particular time; and

a controller configured to;

detect the particular vehicle event based on the generated output signals;

effectuate storage of the set of consecutive frames of visual information in the buffer memory;

determine values of individual frames in the set of consecutive frames, wherein the values of the individual frames decrease with increasing time away from the particular time of the particular vehicle event;

facilitate overwriting of the individual frames stored in the buffer memory based on the determined values; and

responsive to detecting the particular vehicle event, transfer information stored in the buffer memory to the long-term storage memory, wherein the transferred information includes frames of visual information for a period of time that begins before the particular vehicle event and lasts until after the particular vehicle event.

2. The vehicle event recorder system of claim 1, wherein the values of the individual frames further decrease based on similarity of the visual information of the individual frames.

3. The vehicle event recorder system of claim 1, wherein the controller is configured such that the individual frame having the lowest determined value is not the oldest frame stored in the buffer memory.

4. The vehicle event recorder system of claim 3, wherein the controller is configured to assign individual value scores to the set of consecutive frames of visual information such that every n-^th frame, where n is an integer, is assigned a higher score than frames that immediately precede and immediately follow the n-^th frame, which results in a first portion of the frames of visual information stored in the buffer memory having a first higher frame storage rate and a second portion of the frames of visual information stored in the buffer memory having a second lower frame storage rate that is less than or equal to the first higher frame rate divided by n.

5. The vehicle event recorder system of claim 4, wherein the controller is configured such that the second storage density has a variable frame storage rate that corresponds to one or more of the proximity in time to the particular time of the particular vehicle event, a distance traveled by the vehicle, a speed of the vehicle, a pixel difference between consecutive frames of visual information, or a geographic location of the vehicle.

6. The vehicle event recorder system of claim 1, wherein the controller is configured to assign individual value scores to individual frames of visual information stored in the buffer memory based on a pixel difference between consecutive individual frames such that a second individual additional frame that follows a first individual additional frame and has a low pixel difference relative to the first individual additional frame is assigned a low value score and a third individual additional frame that follows the first individual additional frame and has a high pixel difference relative to the first individual additional frame is assigned a high value score.

7. The vehicle event recorder system of claim 1, wherein the controller is configured to assign individual value scores to individual frames of visual information stored in the buffer memory based on one or more of whether the vehicle was moving when the camera captured the individual frames of visual information, whether an operator was present in the vehicle when the camera captured the individual frames of information, a distance traveled by the vehicle, a speed of the vehicle, or a geographic location of the vehicle.

8. The vehicle event recorder system of claim 1, further comprising a flush module configured to facilitate the transfer of the frames of visual information from the buffer memory to the long-term storage memory, the flush module configured to facilitate the transfer of the frames of visual information from the buffer memory, responsive to the detection of the particular vehicle event, at a transfer rate that exceeds a rate at which the frames of visual information are captured by the camera.

9. The vehicle event recorder system of claim 8, wherein the flush module is configured to start the transfer immediately after the detection of the particular vehicle event rather than waiting for all video frames associated with the particular vehicle event to be stored in the buffer memory.

10. The vehicle event recorder system of claim 8, wherein the flush module is configured, responsive to detection of a second vehicle event in temporal proximity to the particular vehicle event, to dynamically extend a duration of the period of time that begins before the particular vehicle event and lasts until after the second vehicle event such that the transferred frames of visual information include frames of visual information for an extended period of time that begins before the particular vehicle event and lasts until after the second vehicle event.

11. A method for storing frames of visual information with a vehicle event recording system, the method comprising:

capturing a set of consecutive frames of visual information representing an environment in and/or around a vehicle with a camera of the vehicle event recording system;

generating output signals conveying vehicle information related to a particular vehicle event with one or more sensors of the vehicle event recording system;

detecting the particular vehicle event based on the generated output signals;

effectuating storage of the consecutively captured frames of visual information in a buffer memory of the vehicle event recording system;

determining values of individual frames in the set of consecutive frames, wherein the values of the individual frames decreases with increasing time away from the particular time of the particular vehicle event;

facilitating overwriting of the individual frames stored in the buffer memory based on the determined values; and

responsive to detecting the particular vehicle event, transferring information stored in the buffer memory to a long-term storage memory, wherein the transferred information includes frames of visual information for a period of time that begins before the particular vehicle event and lasts until after the particular vehicle event.

12. The method of claim 11, wherein the values of the individual frames further decrease based on similarity of the visual information of the individual frames.

13. The method of claim 11, wherein the individual frame having the lowest determined value is not the oldest frame stored in the buffer memory.

14. The method of claim 13, wherein every n-^th frame of the consecutively captured frames of visual information, where n is an integer, is assigned a higher score than frames that immediately preceding and immediately following the n-^th frame, which results in a first portion of the frames of visual information stored in the buffer memory having a first higher frame storage rate and a second portion of the frames of visual information stored in the buffer memory having a second lower frame storage rate that is less than or equal to the first higher frame rate divided by n.

15. The method of claim 14, wherein the second storage density has a variable frame storage rate that corresponds to one or more of the proximity in time to the time of the particular vehicle event, a distance traveled by the vehicle, a speed of the vehicle, a pixel difference between consecutively captured frames of visual information, or a geographic location of the vehicle.

16. The method of claim 11, wherein individual value scores are assigned to individual frames of visual information stored in the buffer memory based on a pixel difference between consecutive individual frames captured by the camera such that a second individual additional frame that consecutively follows a first individual additional frame and has a low pixel difference relative to the first individual additional frame is assigned a low value score and a third individual additional frame that consecutively follows the first individual additional frame and has a high pixel difference relative to the first individual additional frame is assigned a high value score.

17. The method of claim 11, wherein individual value scores are assigned to individual frames of visual information stored in the buffer memory based on one or more of whether the vehicle was moving when the camera captured the individual frames of visual information, whether an operator was present in the vehicle when the camera captured the individual frames of information, a distance travelled by the vehicle, a speed of the vehicle, or a geographic location of the vehicle.

18. The method of claim 11, further comprising facilitating the transfer of the frames of visual information from the buffer memory, responsive to the detection of the particular vehicle event, at a transfer rate that exceeds a rate at which the frames of visual information are captured by the camera.

19. The method of claim 18, wherein the transfer starts immediately after the detection of the particular vehicle event rather than waiting for all video frames associated with the particular vehicle event to be stored in the buffer memory.

20. The method of claim 18, further comprising, responsive to detection of a second vehicle event in temporal proximity to the particular vehicle event, dynamically extending a duration of the period of time that begins before the particular vehicle event and lasts until after the second vehicle event such that the transferred frames of visual information include frames of visual information for an extended period of time that begins before the particular vehicle event and lasts until after the second vehicle event.