Compression and decoding of single sensor color image data

• US 8,718,390 B1
• Filed: 12/16/2013
• Issued: 05/06/2014
• Est. Priority Date: 03/22/2006
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Newman, David A.
• Primary Examiner(s): Tran, Phuoc
• Application Number:
  US14/108,240
• Publication Number:
  US 20140105494A1
• Time in Patent Office: 141 Days
• Field of Search: 382/166, 382/167, 382/233, 382/240, 382/260, 348/266, 348/267, 348/273, 348/280
• US Class Current: 382/233
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H04N 1/648 Transmitting or storing the primary (additive or subtractive) colour signals; Compression thereof H04N1/642 - H04N1/646 take precedence
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 5/265 Mixing

Abstract

A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.

Claims

1. A method for decoding an image comprising:

accessing a first encoded image plane comprising of a sum of image planes representative of a first color, a second encoded image plane comprising a difference between image planes representative of the first color, a third encoded image plane comprising a difference between an image plane of a second color and an image plane of the first color, and a fourth encoded image plane comprising a difference between an image plane of a third color and an image plane of the first color;

in a first operating mode;

decoding the first encoded image plane, the third encoded image plane, and the fourth encoded image plane to form a first set of decoded image planes; and

combining the first set of decoded image planes to form a first decoded image; and

in a second operating mode;

decoding the first encoded image plane, the second encoded image plane, the third encoded image plane, and the fourth encoded image plane to form a second set of decoded image planes; and

combining the second set of decoded image planes to form a second decoded image.

2. The method of claim 1, wherein combining the first set of decoded image planes comprises bypassing de-Bayer filtering of the first set of decoded image planes.

3. The method of claim 1, wherein combining the second set of decoded image planes comprises performing de-Bayer filtering on the second set of decoded image planes.

4. The method of claim 1, wherein the first color comprises green, wherein the second color comprises red, and wherein the third color comprises blue.

5. The method of claim 1, wherein the second decoded image comprises a higher resolution image than the first decoded image.

6. A system for decoding an image comprising:

an input configured to access a first encoded image plane comprising of a sum of image planes representative of a first color, a second encoded image plane comprising a difference between image planes representative of the first color, a third encoded image plane comprising a difference between an image plane of a second color and an image plane of the first color, and a fourth encoded image plane comprising a difference between an image plane of a third color and an image plane of the first color; and

a decoder configured to decode a set of encoded image planes to produce a set of decoded image planes and to combine the set of decoded image planes to produce a decoded image, wherein in a first decoder operating mode, the set of encoded image planes comprises the first encoded image plane, the third encoded image plane, and the fourth encoded image plane, and wherein in a second decoder operating mode, the set of encoded image planes comprises the first encoded image plane, the second encoded image plane, the third encoded image plane, and the fourth encoded image plane; and

an output configured to store the decoded image in a memory.

7. The system of claim 6, wherein the decoder is configured to bypass de-Bayer filtering of the set of decoded image planes when combining the set of decoded image planes in the first decoder operating mode.

8. The system of claim 6, wherein the decoder is configured to perform de-Bayer filtering on the set of decoded image planes when combining the set of decoded image planes in the second decoder operating mode.

9. The system of claim 6, wherein the first color comprises green, wherein the second color comprises red, and wherein the third color comprises blue.

10. The system of claim 6, wherein the second decoded image comprises a higher resolution image than the first decoded image.

11. A method for decoding an image comprising:

accessing an encoded image comprising;

a first encoded image plane comprising image information representative of a difference between a second color and a first color;

a second encoded image plane comprising image information representative of a difference between a third color and the first color; and

a third encoded image plane and a fourth encoded image plane each comprising image information representative of the first color;

decoding the first encoded image plane to form a first decoded image plane;

decoding the second encoded image plane to form a second decoded image plane;

decoding one of the third encoded image plane and the fourth encoded image plane to form a third decoded image plane; and

combining the first decoded image plane, the second decoded image plane, and the third decoded image plane to produce a decoded image.

12. The method of claim 11, wherein combining the decoded image planes comprises bypassing de-Bayer filtering of the decoded image planes.

13. The method of claim 11, wherein combining the decoded image planes comprises combining for each pixel in the image, corresponding pixel information in the first decoded image plane, the second decoded image plane, and the third decoded image plane.

14. The method of claim 13, wherein combining pixel information comprises interleaving pixel information in the first decoded image plane, the second decoded image plane, and the third decoded image plane.

15. The method of claim 11, wherein the first color comprises green, wherein the second color comprises red, and wherein the third color comprises blue.

16. A system for decoding an image comprising:

an input configured to access an encoded image comprising;

a first encoded image plane comprising image information representative of a difference between a second color and a first color;

a second encoded image plane comprising image information representative of a difference between a third color and the first color; and

a third encoded image plane and a fourth encoded image plane each comprising image information representative of the first color;

a decoder configured to;

decode the first encoded image plane to form a first decoded image plane;

decode the second encoded image plane to form a second decoded image plane;

decode one of the third encoded image plane and the fourth encoded image plane to form a third decoded image plane; and

combine the first decoded image plane, the second decoded image plane, and the third decoded image plane to produce a decoded image; and

an output configured to store the decoded image in a memory.

17. The system of claim 16, wherein combining the decoded image planes comprises bypassing de-Bayer filtering of the decoded image planes.

18. The system of claim 16, wherein combining the decoded image planes comprises combining for each pixel in the image, corresponding pixel information in the first decoded image plane, the second decoded image plane, and the third decoded image plane.

19. The system of claim 18, wherein combining pixel information comprises interleaving pixel information in the first decoded image plane, the second decoded image plane, and the third decoded image plane.

20. The system of claim 16, wherein the first color comprises green, wherein the second color comprises red, and wherein the third color comprises blue.