Compression and decoding of single sensor color image data

• US 8,644,629 B2
• Filed: 08/15/2013
• Issued: 02/04/2014
• Est. Priority Date: 03/22/2006
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Newman, David A.
• Primary Examiner(s): Tran, Phuoc
• Application Number:
  US13/968,423
• Publication Number:
  US 20130329992A1
• Time in Patent Office: 173 Days
• Field of Search: 382/166, 382/167, 382/233, 382/240, 382/260, 348/266, 348/267, 348/273, 348/280
• US Class Current: 382/233
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H04N 1/648 Transmitting or storing the primary (additive or subtractive) colour signals; Compression thereof H04N1/642 - H04N1/646 take precedence
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 5/265 Mixing

Abstract

A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.

Claims

1. A method for decompressing an image comprising:

accessing a first modified image plane, a second modified image plane, and a third modified image plane, the accessed modified image planes comprising components of an encoded image;

decoding a product of a factor of 0.5 and a sum of pixel values of the first modified image plane and pixel values of the third modified image plane into a first decoded image plane;

decoding a product of a factor of 0.5 and a sum of pixel values of the second modified image plane and pixel values of the third modified image plane into a second decoded image plane;

decoding a product of a factor of 0.5 and pixel values of the third image plane into a third decoded image plane; and

storing the first decoded image plane, the second decoded image plane, and the third decoded image plane in a memory.

2. The method of claim 1, further comprising:

generating a preview image of the encoded image based on the first decoded image plane, the second decoded image plane, and the third decoded image plane.

3. The method of claim 2, wherein each pixel of the preview image comprises a pixel value from the first decoded image plane, a pixel value from the second decoded image plane, and a pixel value from the third decoded image plane.

4. The method of claim 2, further comprising:

displaying the preview image.

5. The method of claim 1, wherein the first decoded image plane, the second decoded image plane, and the third decoded image plane each comprise color information representing a different color.

6. A system for decompressing an image comprising:

an input configured to access a first modified image plane, a second modified image plane, and a third modified image plane, the accessed modified image planes comprising components of an encoded image;

a decoder configured to;

decode a product of a factor of 0.5 and a sum of pixel values of the first modified image plane and pixel values of the third modified image plane into a first decoded image plane;

decode a product of a factor of 0.5 and a sum of pixel values of the second modified image plane and pixel values of the third modified image plane into a second decoded image plane; and

decode a product of a factor of 0.5 and pixel values of the third image plane into a third decoded image plane; and

an output configured to store the first decoded image plane, the second decoded image plane, and the third decoded image plane in a memory.

7. The system of claim 6, further comprising:

an image generator configured to generate a preview image of the encoded image based on the first decoded image plane, the second decoded image plane, and the third decoded image plane.

8. The system of claim 7, wherein each pixel of the preview image comprises a pixel value from the first decoded image plane, a pixel value from the second decoded image plane, and a pixel value from the third decoded image plane.

9. The system of claim 7, further comprising:

a display configured to display the preview image.

10. The system of claim 6, wherein the first decoded image plane, the second decoded image plane, and the third decoded image plane each comprise color information representing a different color.

11. A method for decompressing an image comprising:

accessing a first encoded image plane comprising, for each pixel in an image frame, an encoded difference between an associated pixel value in a first color plane multiplied by a factor of 2 and a sum of an associated pixel value in a second color plane and an associated pixel value in a third color plane;

accessing a second encoded image plane comprising, for each pixel in the image frame, an encoded sum of an associated pixel value in the second color plane and an associated pixel value in the third color plane;

decoding a product of a factor of 0.5 and a sum of each pixel value in the first encoded image plane and an associated pixel value in the second encoded image plane into a decoded image plane; and

storing the decoded image plane in a memory.

12. The method of claim 11, further comprising:

generating a preview image based on the decoded image plane.

13. The method of claim 12, wherein each pixel of the preview image comprises a pixel value from the decoded image plane.

14. The method of claim 12, further comprising:

displaying the preview image.

15. The method of claim 11, wherein the decoded image plane comprises color information representing one of red, blue, and green.

16. A system for decompressing an image comprising:

an input configured to;

access a first encoded image plane comprising, for each pixel in an image frame, an encoded difference between an associated pixel value in a first color plane multiplied by a factor of 2 and a sum of an associated pixel value in a second color plane and an associated pixel value in a third color plane; and

access a second encoded image plane comprising, for each pixel in the image frame, an encoded sum of an associated pixel value in the second color plane and an associated pixel value in the third color plane;

a decoder configured to decode a product of a factor of 0.5 and a sum of each pixel value in the first encoded image plane and an associated pixel value in the second encoded image plane into a decoded image plane; and

an output configured to store the decoded image plane in a memory.

17. The system of claim 16, further comprising:

an image generator configured to generate a preview image based on the decoded image plane.

18. The system of claim 17, wherein each pixel of the preview image comprises a pixel value from the decoded image plane.

19. The system of claim 17, further comprising:

a display configured to display the preview image.

20. The system of claim 16, wherein the decoded image plane comprises color information representing one of red, blue, and green.