Compression and decoding of single sensor color image data

• US 9,736,384 B2
• Filed: 07/20/2016
• Issued: 08/15/2017
• Est. Priority Date: 03/22/2006
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Newman, David A.
• Primary Examiner(s): Bayat, Ali
• Application Number:
  US15/215,397
• Publication Number:
  US 20160344938A1
• Time in Patent Office: 391 Days
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H04N 1/648 Transmitting or storing the primary (additive or subtractive) colour signals; Compression thereof H04N1/642 - H04N1/646 take precedence
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 5/265 Mixing

Abstract

A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.

Claims

1. A method for displaying captured image data, the method comprising:

receiving, by an image processing system, image data captured by an image sensor of a camera, the image data comprising a plurality of image planes, the image processing system configured to perform an editing operation on the image data;

selecting one of a plurality of de-Bayer filters based on the editing operation, each of the plurality of de-Bayer filters associated with a different filter style;

filtering, by the image processing system, a subset of the plurality of image planes of the received image data using the selected de-Bayer filter to produce an output image; and

providing, by the image processing system, the output image to a display configured to display the output image.

2. The method of claim 1, wherein the subset of the plurality of image planes comprises all of the plurality of image plans.

3. The method of claim 1, wherein the subset of the plurality of image planes comprises less than all of the plurality of image plans.

4. The method of claim 1, wherein the image data is encoded by the camera before the image data is received by the image processing system.

5. The method of claim 1, wherein the selected de-Bayer filter is selected by a user of the image processing system.

6. An image processing system comprising:

an input configured to receive image data captured by an image sensor of a camera, the image data comprising a plurality of image planes;

an image processor configured to;

select one of a plurality of de-Bayer filters based on an editing operation that the image processor is configured to perform on the image data, each of the plurality of de-Bayer filters associated with a different filter style; and

filter a subset of the plurality of image planes of the received image data using the selected de-Bayer filter to produce an output image; and

an output configured to provide the output image to a display configured to display the output image.

7. The image processing system of claim 6, wherein the subset of the plurality of image planes comprises all of the plurality of image plans.

8. The image processing system of claim 6, wherein the subset of the plurality of image planes comprises less than all of the plurality of image plans.

9. The image processing system of claim 6, wherein the image data is encoded by the camera before the image data is received by the image processor system.

10. The image processing system of claim 6, wherein the de-Bayer filter is selected by the image processor in response to a selection of the de-Bayer filter by a user of the image processor system.

11. A non-transitory computer-readable storage medium storing computer-readable instructions that, when executed by a hardware processor, cause an image processor system to perform steps comprising:

receiving image data captured by an image sensor of a camera, the image data comprising a plurality of image planes;

selecting one of a plurality of de-Bayer filters based on an editing operation that the image processor system is configured to perform on the image data, each of the plurality of de-Bayer filters associated with a different filter style;

filtering a subset of the plurality of image planes of the received image data using the selected de-Bayer filter to produce an output image; and

providing the output image to a display configured to display the output image.

12. The non-transitory computer-readable storage medium of claim 11, wherein the subset of the plurality of image planes comprises all of the plurality of image plans.

13. The non-transitory computer-readable storage medium of claim 11, wherein the subset of the plurality of image planes comprises less than all of the plurality of image plans.

14. The non-transitory computer-readable storage medium of claim 11, wherein the image data is encoded by the camera before the image data is received by the image processing system.

15. The non-transitory computer-readable storage medium of claim 11, wherein the selected de-Bayer filter is selected by a user of the image processing system.