Compression and Decoding of Single Sensor Color Image Data

• US 20170318229A1
• Filed: 07/19/2017
• Published: 11/02/2017
• Est. Priority Date: 03/22/2006
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Newman, David A.
• Granted Patent: US 10,212,352 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 9/00 Image coding bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00
• CPC Class Codes: H04N 1/648 Transmitting or storing the primary (additive or subtractive) colour signals; Compression thereof H04N1/642 - H04N1/646 take precedence
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 5/265 Mixing

Abstract

A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.

Claims

1. A method for editing captured image data, the method comprising:

receiving, by an image processing system, image data corresponding to a first resolution captured by an image sensor of a camera, the image data comprising a plurality of image planes;

encoding, by the image processing system, a subset of the image planes to produce a preview image at a second resolution lower than the first resolution;

receiving, by the image processing system, an edit operation to the preview image; and

providing, by the image processing system, the image data and the received edit to an editing system, the editing system configured to decoding the plurality of image planes to produce an image at the first resolution and to perform the received edit operation on the image at the first resolution.

2. The method of claim 1, wherein the subset of the plurality of image planes comprises all of the plurality of image plans.

3. The method of claim 1, wherein the subset of the plurality of image planes comprises less than all of the plurality of image plans.

4. The method of claim 1, wherein encoding the subset of encoded image planes comprises combining the subset of image planes to produce the preview image.

5. The method of claim 1, wherein the received edit operation identifies a subset of the image data.

6. The method of claim 5, wherein the editing system performs a de-Bayer operation only on the identified subset of the image data.

7. The method of claim 5, wherein the image processing system provides only the identified subset of the image data to the editing system.

8. A system for editing image data, the system comprising:

an input configured to receive image data corresponding to a first resolution captured by an image sensor of a camera, the image data comprising a plurality of image planes;

a processor configured to;

encode a subset of the image planes to produce a preview image at a second resolution lower than the first resolution; and

receive an edit operation to the preview image; and

an output configured to provide the image data and the received edit to an editing system, the editing system configured to decoding the plurality of image planes to produce an image at the first resolution and to perform the received edit operation on the image at the first resolution.

9. The system of claim 8, wherein the subset of the plurality of image planes comprises all of the plurality of image plans.

10. The system of claim 8, wherein the subset of the plurality of image planes comprises less than all of the plurality of image plans.

11. The system of claim 8, wherein encoding the subset of encoded image planes comprises combining the subset of image planes to produce the preview image.

12. The system of claim 8, wherein the received edit operation identifies a subset of the image data.

13. The system of claim 12, wherein the editing system performs a de-Bayer operation only on the identified subset of the image data.

14. The system of claim 12, wherein the image processing system provides only the identified subset of the image data to the editing system.

15. A non-transitory computer-readable storage medium storing computer-readable instructions that, when executed by a hardware processor, cause an image processing system to perform steps comprising:

receiving, by the image processing system, image data corresponding to a first resolution captured by an image sensor of a camera, the image data comprising a plurality of image planes;

encoding, by the image processing system, a subset of the image planes to produce a preview image at a second resolution lower than the first resolution;

receiving, by the image processing system, an edit operation to the preview image; and

providing, by the image processing system, the image data and the received edit to an editing system, the editing system configured to decoding the plurality of image planes to produce an image at the first resolution and to perform the received edit operation on the image at the first resolution.

16. The non-transitory computer-readable storage medium of claim 15, wherein the subset of the plurality of image planes comprises all of the plurality of image plans.

17. The non-transitory computer-readable storage medium of claim 15, wherein the subset of the plurality of image planes comprises less than all of the plurality of image plans.

18. The non-transitory computer-readable storage medium of claim 15, wherein encoding the subset of encoded image planes comprises combining the subset of image planes to produce the preview image.

19. The non-transitory computer-readable storage medium of claim 15, wherein the received edit operation identifies a subset of the image data.

20. The non-transitory computer-readable storage medium of claim 19, wherein the editing system performs a de-Bayer operation only on the identified subset of the image data.

21. The non-transitory computer-readable storage medium of claim 19, wherein the image processing system provides only the identified subset of the image data to the editing system.