Census transform data compression methods and systems

• US 9,986,260 B2
• Filed: 11/14/2014
• Issued: 05/29/2018
• Est. Priority Date: 11/14/2014
• Status: Active Grant

• Current Assignee: Avago Technologies International Sales Pte Limited (Broadcom, Inc.)
• Original Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Inventors: Zhou, Minhua
• Primary Examiner(s): Aghevli, Reza
• Application Number:
  US14/542,190
• Publication Number:
  US 20160142736A1
• Time in Patent Office: 1,292 Days
• Field of Search: None
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

An video image processing device configured to generate one or more census digit planes, and to generate one or more signature vectors based on the one or more census digit planes. The video image processing device can include one or more census transforms configured to perform one or more census transformations to generate the signature vector(s) based on the census digit plane(s).

Claims

1. A video image processing device, comprising:

a transmitter configured to transmit a residual bitstream via a communication link; and

processor circuitry communicatively coupled to the transmitter, the processor circuitry including;

an encoder, including a decoder, configured to;

receive uncompressed video image data from an image sensor and compress the uncompressed video image data to generate compressed video image data; and

decompress, by the decoder, the compressed video image data to generate decompressed video image data;

a first census transform configured to generate one or more uncompressed census digit planes based on the uncompressed video image data;

a second census transform configured to generate one or more decompressed census digit planes based on the decompressed video image data, wherein the decompressed video image data was previously compressed by the encoder;

a subtractor configured to receive the one or more uncompressed census digit planes and the one or more decompressed census digit planes, and to generate one or more residual census digit planes based on the one or more uncompressed census digit planes and the one or more decompressed census digit planes; and

a residual census digit generator configured to generate the residual bitstream based on the one or more residual census digit planes.

2. The video image processing device of claim 1, wherein the residual census digit generator is configured to generate the residual bitstream based on a difference of a census digit of the one or more uncompressed census digit planes and a corresponding census digit of the one or more decompressed census digit planes.

3. The video image processing device of claim 1, wherein the subtractor is configured to:

subtract a census digit of the one or more decompressed census digit planes from a corresponding census digit of the one or more uncompressed census digit planes to generate the one or more residual census digit planes.

4. The video image processing device of claim 1, wherein the transmitter is further configured to transmit the compressed video image data via the communication link.

5. The video image processing device of claim 1, wherein the transmitter is configured to transmit the residual bitstream utilizing an Ethernet protocol.

6. The video image processing device of claim 1, wherein the communication link is an Ethernet communication link.

16. The video image processing device of claim 1, wherein:

for a selected pixel in the uncompressed video image data having a pixel intensity, each of the one or more uncompressed census digit planes represents a neighboring pixel intensity of a neighboring pixel relative to the pixel intensity of the selected pixel in the uncompressed video image data, wherein the neighboring pixel is located at a different predetermined location relative to the selected pixel for each of the one or more uncompressed census digit planes, and

for a selected pixel in the decompressed video image data having a pixel intensity, each of the one or more decompressed census digit planes represents a neighboring pixel intensity of a neighboring pixel relative to the pixel intensity of the selected pixel in the decompressed video image data, wherein the neighboring pixel is located at a different predetermined location relative to the selected pixel for each of the one or more decompressed census digit planes.

19. The video image processing device of claim 1, wherein the image sensor is configured to capture a video image and generate the uncompressed video image data based on the video image.

7. A video image processing device, comprising:

a receiver configured to receive a residual bitstream and compressed video image data via a communication link; and

processor circuitry communicatively coupled to the receiver, the processor circuitry including;

a census digit generator configured to generate one or more residual census digit planes based on the received residual bitstream;

a decoder configured to receive the compressed video image data from the receiver and decompress the compressed video image data to generate decompressed video image data;

a census transform configured to generate one or more decompressed census digit planes based on the decompressed video image data;

an adder configured to receive the one or more residual census digit planes and the one or more decompressed census digit planes, and to generate one or more reconstructed census digit planes based on the one or more residual census digit planes and the one or more decompressed census digit planes; and

a signature vector generator configured to generate a signature vector based on the one or more reconstructed census digit planes.

8. The video image processing device of claim 7, wherein the decompressed video image data is a decompressed version of compressed video image data received by the receiver.

9. The video image processing device of claim 7, wherein the signature vector generator is configured to generate the signature vector based on a sum of a census digit of the one or more decompressed census digit planes and a corresponding census digit of the one or more residual census digit planes.

10. The video image processing device of claim 7, wherein the adder is configured to add a census digit of the one or more decompressed census digit planes and a corresponding census digit of the one or more residual census digit planes to generate the one or more reconstructed census digit planes.

11. The video image processing device of claim 10, wherein the one or more reconstructed census digit planes correspond to one or more census digit planes generated from uncompressed video image data.

17. The video image processing device of claim 7, wherein:

for a selected pixel in the decompressed video image data having a pixel intensity, each of the one or more decompressed census digit planes represents a neighboring pixel intensity of a neighboring pixel relative to the pixel intensity of the selected pixel in the decompressed video image data, wherein the neighboring pixel is located at a different predetermined location relative to the selected pixel for each of the one or more decompressed census digit planes.

12. A video image processing method, comprising:

receiving uncompressed video image data from an image sensor;

compressing the uncompressed video image data to generate compressed video image data;

decompressing the compressed video image data to generate uncompressed video image data;

generating one or more uncompressed census digit planes using the uncompressed video image data;

generating one or more decompressed census digit planes using the decompressed video image data, wherein the decompressed video image data was previously compressed;

generating one or more residual census digit planes based on the one or more uncompressed census digit planes and the one or more decompressed census digit planes;

generating a residual bitstream based on the one or more residual census digit planes; and

transmitting the compressed video image data and the residual bitstream via a communication link.

13. The video image processing method of claim 12, further comprising:

receiving the residual bitstream via the communication link;

generating one or more reconstructed residual census digit planes based on the received residual bitstream;

generating one or more second decompressed census digit planes based on second decompressed video image data;

generating one or more reconstructed census digit planes based on the one or more reconstructed residual census digit planes and the one or more second decompressed census digit planes; and

generating a signature vector based on the one or more reconstructed census digit planes.

14. The video image processing method of claim 13, further comprising:

receiving the compressed video image data via the communication link; and

decompressing the compressed video image data to generate the second decompressed video image data.

15. The video image processing method of claim 13, wherein the generating the one or more residual census digit planes includes subtracting a census digit of the one or more decompressed census digit planes from a corresponding census digit of the one or more uncompressed census digit planes to generate the one or more residual census digit planes;

and

wherein the generating the one or more reconstructed census digit planes includes adding a census digit of the one or more reconstructed residual census digit planes and a corresponding census digit of the one or more second decompressed census digit planes to generate the one or more reconstructed census digit planes.

18. The video image processing method of claim 12, wherein:

for a selected pixel in the uncompressed video image data having a pixel intensity, each of the one or more uncompressed census digit planes represents a neighboring pixel intensity of a neighboring pixel relative to the pixel intensity of the selected pixel in the uncompressed video image data, wherein the neighboring pixel is located at a different predetermined location relative to the selected pixel for each of the one or more uncompressed census digit planes, and

for a selected pixel in the decompressed video image data having a pixel intensity, each of the one or more decompressed census digit planes represents a neighboring pixel intensity of a neighboring pixel relative to the pixel intensity of the selected pixel in the decompressed video image data, wherein the neighboring pixel is located at a different predetermined location relative to the selected pixel for each of the one or more decompressed census digit planes.

20. The video image processing method of claim 12, further comprising:

using the image sensor, capturing a video image and generating the uncompressed video image data based on the video image.