Video compression system

• US 8,358,686 B2
• Filed: 10/16/2007
• Issued: 01/22/2013
• Est. Priority Date: 10/17/2006
• Status: Expired due to Fees

• Current Assignee: Harman Becker Automotive Systems GmbH (Samsung Group)
• Original Assignee: Harman Becker Automotive Systems GmbH (Samsung Group)
• Inventors: Stephan, Martin, Mohr, Ulrich
• Primary Examiner(s): Divecha, Nishant B
• Application Number:
  US11/873,051
• Publication Number:
  US 20080187047A1
• Time in Patent Office: 1,925 Days
• Field of Search: None
• US Class Current: 375/240.01
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/527 Global motion vector estimation
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A video compression system processes images captured from a video camera mounted to a vehicle. Vehicle-mounted sensors generate vehicle motion information corresponding to a current state of motion of the vehicle. An optical flow estimation circuit estimates apparent motion of objects within a visual field. A video encoder circuit in communication with the optical flow estimation circuit compresses the video data from the video camera based on the estimated apparent motion.

Claims

1. A video compression system comprising:

a video camera mounted to or in a vehicle, and configured to generate video data;

at least one sensor configured to generate vehicle motion information corresponding to a current state of motion of the vehicle;

an optical flow estimation circuit configured to generate an estimated apparent motion of objects within a visual field of the video camera, where the optical flow estimation circuit chooses a starting value for determining the motion vectors by selecting an appropriate vector of a vector field for each block of the video image associated with the current state of motion of the vehicle;

a video encoder circuit in communication with the optical flow estimation circuit, and configured to compress the video data in accordance with the estimated apparent motion of objects;

where the optical flow estimation circuit further comprises;

a motion reconstruction circuit configured to reconstruct the current state of motion of the vehicle, wherein the reconstruction is based on the vehicle motion information provided by the at least one sensor; and

wherein the estimated apparent motion of objects is determined in accordance with the reconstructed state of motion of the vehicle.

2. The system of claim 1, where the estimated apparent motion of objects includes qualitative information indicating a type of flow field.

3. The system of claim 1, where the estimated apparent motion of objects includes a vector field representation.

4. The system of claim 1, where the video encoder circuit comprises:

a model circuit configured to generate motion vectors indicating motion within the video data, the motion vectors determined based on the estimated apparent motion of objects; and

a predictive coding circuit configured generate predicted video data based on the motion vectors, and configured to determine differences between the video data and predicted video data.

5. The system of claim 4, where the model circuit generates the motion vectors by searching a predefined search range of possible motion vectors.

6. The system of claim 5, where the model circuit determines a search range based on the estimated apparent motion of objects.

7. The system of claim 5, where the model circuit determines a starting value for searching the motion vectors based on the estimated apparent motion of objects.

8. The system of claim 4, where the video encoder circuit comprises a segmentation circuit configured to partition video images into blocks, and where the model circuit determines motion vectors for each block based on the estimated apparent motion of objects and a location of the block within the video image.

9. The system of claim 1, where the video encoder circuit compresses the video data according to an MPEG (Motion Picture Experts Group) format.

10. The system of claim 1, where the at least one sensor comprises a tachometer, an accelerometer, an angular sensor, a distance sensor, a gyroscope, a compass, or a GPS receiver.

11. The system of claim 1, where the vehicle motion information includes velocity, direction of motion, linear acceleration, or radial acceleration.

12. The system of claim 1, further comprising a digital communication bus to facilitate communication between the sensors and the video encoder circuit.

13. The system of claim 12, comprising:

a video decoder configured to decode the compressed video information; and

a display device in communication with the decoder, where the display device is configured to display the decoded compressed video data.

14. The system of claim 12, comprising a recording device in communication with the video encoder circuit through the communication bus, where the recording device is configured to store the compressed video data.

15. A video compression system in or on a vehicle, comprising:

a video camera mounted to or in the vehicle, the camera configured to generate video data;

at least one sensor configured to generate vehicle motion information corresponding to a current state of motion of the vehicle;

an optical flow estimation circuit configured to generate an estimated apparent motion of objects within a visual field of the video camera, where the optical flow estimation circuit chooses a starting value for determining the motion vectors by selecting an appropriate vector of a vector field for each block of the video image associated with the current state of motion of the vehicle;

where the optical flow estimation circuit further comprises;

a motion reconstruction circuit configured to reconstruct the current state of motion of the vehicle, wherein the reconstruction is based on the vehicle motion information provided by the at least one sensor; and

wherein the estimated apparent motion of objects is determined in accordance with the reconstructed state of motion of the vehicle;

a video encoder circuit in communication with the optical flow estimation circuit, and configured to compress the video data in accordance with the estimated apparent motion of objects; and

the video encoder circuit further comprising;

a model circuit configured to generate motion vectors indicating motion within the video data, the motion vectors determined based on the estimated apparent motion of objects; and

a predictive coding circuit configured generate predicted video data based on the motion vectors, and configured to determine differences between the video data and predicted video data.

16. A method for compressing video data generated by a video camera mounted in or on a vehicle, the method comprising:

generating, by the video camera, video data;

generating, by at least one sensor, vehicle motion information corresponding to a current state of motion of the vehicle;

estimating, by an optical flow estimation circuit, an apparent motion of objects within a visual field of the video camera, wherein the optical flow estimation circuit chooses a starting value for determining the motion vectors by selecting an appropriate vector of a vector field for each block of the video image associated with the current state of motion of the vehicle; and

compressing, by a video encoder circuit, the video data in accordance with the estimated apparent motion of objects, wherein the video encoder circuit is communicating with the optical flow estimation circuit;

reconstructing, by a motion reconstruction circuit of the optical flow estimation circuit, the current state of motion of the vehicle based on the sensor data;

wherein estimating the apparent motion of objects is based on the reconstructed current state of motion of the vehicle.

17. The method of claim 16, where estimating the apparent motion of objects generates qualitative information indicating a type of flow field.

18. The method of claim 16, where estimating the apparent motion of objects generates vector field representation information.

19. The method of claim 16 comprising:

determining motion vectors indicative of motion within a subsequent video image, the motion vectors determined based on the estimated apparent motion of objects within the visual field of the camera; and

predictively coding differences between the video data and video images predicted from the motion vectors.

20. The method of claim 19, comprising determining the motion vectors by searching a predefined search range of possible motion vectors.

21. The method of claim 20, comprising determining the motion vectors by establishing a search range in accordance with the estimated apparent motion of objects.

22. The method of claim 20, comprising:

segmenting a video image into a plurality of data blocks; and

determining motion vectors for each block in accordance with the estimated apparent motion of objects and a location of the block within the video image.