Resolution based formatting of compressed image data

• US 9,906,764 B2
• Filed: 09/13/2016
• Issued: 02/27/2018
• Est. Priority Date: 12/16/2009
• Status: Active Grant

• Current Assignee: Red.com, LLC
• Original Assignee: Red.com, LLC
• Inventors: Jannard, James H., Lohman, Rob Wouter, Greene, Richard
• Primary Examiner(s): Bella, Matthew
• Assistant Examiner(s): TORRES, JOSE
• Application Number:
  US15/264,454
• Publication Number:
  US 20170099475A1
• Time in Patent Office: 532 Days
• Field of Search: None
• CPC Class Codes: G06T 9/005 Statistical coding, e.g. Huffman, run length coding
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 9/64 Circuits for processing colour signals H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84

Abstract

The disclosure herein relates to devices for compression, decompression or reconstruction of image data for still or moving pictures, such as image data detected with a digital camera. In some embodiments, data channels are compressed using a scalable compression algorithm. The compression algorithm may allow customization of compression parameters, such as a quantization factor, code block size, number of transform levels, reversible or irreversible compression, a desired compression ratio with a variable bit rate output, a desired fixed bit rate output with a variable compression rate, progression order, output format, or visual weighting. A lower quality image or an image with lower resolution may be reconstructed using only some of the compressed data. Use of offsets to various layers and color channels allow reconstruction of the image without requiring decompression of all of the full image data.

Claims

1. An imaging device, comprising:

a color filter array comprising at least red, green, and blue filter elements arranged in a repeating pattern;

at least one image sensor that receives light passing through the filter elements and captures a plurality of image frames in a motion video image sequence, wherein an image frame comprises a red color portion, a blue color portion, a first green color portion, and a second green color portion;

processing circuitry configurable to operate in a resolution-based mode to;

transform the red color portion into a first red data set corresponding to a first resolution and at least a second red data set corresponding to a second resolution that is higher than the first resolution, wherein reconstruction of the red portion of the image frame at the first resolution is based on the first red data set and is independent of the second red data set, and reconstruction of the red image frame at the second resolution is based on the first red data set and the second red data set;

transform the blue color portion into a first blue data set corresponding to the first resolution and at least a second blue data set corresponding to the second resolution, wherein reconstruction of the blue portion of the image frame at the first resolution is based on the first blue data set and is independent of the second blue data set, and reconstruction of the blue portion of the image frame at the second resolution is based on the first blue data set and the second blue data set;

transform the first green color portion into a first green data set corresponding to the first resolution and at least a second green data set corresponding to the second resolution, wherein reconstruction of the first green portion of the image frame at the first resolution is based on the first green data set and is independent of the second green data set, and reconstruction of the first green portion of the image frame at the second resolution is based on the first green data set and the second green data set;

transform the second green color portion into a third green data set corresponding to the first resolution and at least a fourth green data set corresponding to the second resolution, wherein reconstruction of the second green portion of the image frame at the first resolution is based on the third green data set and is independent of the fourth green data set, and reconstruction of the second green portion of the image frame at the second resolution is based on the third green data set and the fourth green data set;

compress the first red data set;

compress the second red data set;

compress the first blue data set;

compress the second blue data set;

compress the first green data set;

compress the second green data set;

compress the third green data set;

compress the fourth green data set;

organize the compressed data sets into at least a first arrangement of one or more data blocks that contains the compressed first red data set, the compressed first blue data set, and the compressed first green data set, and a second arrangement of one or more data blocks that are different from the first arrangement of data blocks and that contains the compressed second red set, the compressed second blue data set, and the compressed second green data set, wherein the first arrangement does not contain the compressed third green data set and the compressed fourth green data set; and

store on a storage device the first arrangement of data blocks, at least a first location reference to the first arrangement of data blocks, the second arrangement of data blocks, and at least a second location reference to the second arrangement of data blocks.

2. The imaging device of claim 1, wherein the data blocks are contained in a file, with location references being offset indicators to blocks of data within the file structure.

3. The imaging device of claim 2, wherein location reference values that have neighboring numbers refer to adjacent blocks of data within the file structure.

4. The imaging device of claim 1, wherein the resolution based mode further operates to organize the compressed second red set, the compressed second blue data set, and the compressed second green data set in one or more blocks that are different from blocks that contain the compressed third green data set and the compressed fourth green data set.

5. The imaging device of claim 4, wherein the resolution based mode further operates to organize the third green data set in one or more blocks that are different from blocks that contain the compressed fourth green data set.

6. The imaging device of claim 1, wherein the resolution based mode further operates to transform the red, blue, first green, and second green color portions into data sets corresponding to a plurality of resolution levels, wherein reconstruction of a color portion of an image frame at a particular resolution is based on the color portion data sets corresponding to that resolution level and any color portion data sets corresponding to lower resolution levels.

7. A method of storing color image data, comprising:

electronically capturing a plurality of image frames in a motion video image sequence, wherein an image frame comprises a red color portion, a blue color portion, a first green color portion, and a second green color portion;

transforming the red color portion into a first red data set corresponding to a first resolution and at least a second red data set corresponding to a second resolution that is higher than the first resolution, wherein reconstruction of the red portion of the image frame at the first resolution is based on the first red data set and is independent of the second red data set, and reconstruction of the red image frame at the second resolution is based on the first red data set and the second red data set;

transforming the blue color portion into a first blue data set corresponding to the first resolution and at least a second blue data set corresponding to the second resolution, wherein reconstruction of the blue portion of the image frame at the first resolution is based on the first blue data set and is independent of the second blue data set, and reconstruction of the blue portion of the image frame at the second resolution is based on the first blue data set and the second blue data set;

transforming the first green color portion into a first green data set corresponding to the first resolution and at least a second green data set corresponding to the second resolution, wherein reconstruction of the first green portion of the image frame at the first resolution is based on the first green data set and is independent of the second green data set, and reconstruction of the first green portion of the image frame at the second resolution is based on the first green data set and the second green data set;

transforming the second green color portion into a third green data set corresponding to the first resolution and at least a fourth green data set corresponding to the second resolution, wherein reconstruction of the second green portion of the image frame at the first resolution is based on the third green data set and is independent of the fourth green data set, and reconstruction of the second green portion of the image frame at the second resolution is based on the third green data set and the fourth green data set;

compressing the first red data set;

compressing the second red data set;

compressing the first blue data set;

compressing the second blue data set;

compressing the first green data set;

compressing the second green data set;

compressing the third green data set;

compressing the fourth green data set;

organizing the compressed data sets into at least a first arrangement of one or more data blocks that contains the compressed first red data set, the compressed first blue data set, and the compressed first green data set, and a second arrangement of one or more data blocks that are different from the first arrangement of data blocks and that contains the compressed second red set, the compressed second blue data set, and the compressed second green data set, wherein the first arrangement does not contain the compressed third green data set and the compressed fourth green data set; and

storing on a storage device the first arrangement of data blocks, at least a first location reference to the first arrangement of data blocks, the second arrangement of data blocks, and at least a second location reference to the second arrangement of data blocks.

8. The method of claim 7, further comprising transmitting to an image reconstruction device the first arrangement of data blocks without transmitting the second arrangement of data blocks.

9. The method of claim 8, further comprising transmitting to an image reconstruction device color portion data sets corresponding to the particular resolution level and any color portion data sets corresponding to lower resolution levels without transmitting color portion data sets corresponding to higher resolution levels.

10. The method of claim 7, further comprising transforming the red, blue, first green, and second green color portions into data sets corresponding to a plurality of resolution levels, wherein reconstruction of a color portion of an image frame at a particular resolution is based on the color portion data sets corresponding to that resolution level and any color portion data sets corresponding to lower resolution levels.

11. The method of claim 7, wherein the data blocks are contained in a file, with location references being offset indicators to blocks of data within the file structure.

12. The method of claim 11, wherein location reference values that have neighboring numbers refer to adjacent blocks of data within the file structure.

13. The method of claim 7, wherein organizing the compressed data sets comprises organizing the compressed second red set, the compressed second blue data set, and the compressed second green data set in one or more blocks that are different from blocks that contain the compressed third green data set and the compressed fourth green data set.

14. The method of claim 13, wherein organizing the compressed data sets comprises organizing the third green data set in one or more blocks that are different from blocks that contain the compressed fourth green data set.