Resolution based formatting of compressed image data

• US 9,479,749 B2
• Filed: 11/15/2013
• Issued: 10/25/2016
• Est. Priority Date: 12/16/2009
• Status: Active Grant

• Current Assignee: Red.com, LLC
• Original Assignee: Redcom Com Incorporated
• Inventors: Jannard, James H., Lohman, Rob Wouter, Greene, Richard
• Primary Examiner(s): Bella, Matthew
• Assistant Examiner(s): TORRES, JOSE
• Application Number:
  US14/081,297
• Publication Number:
  US 20140176734A1
• Time in Patent Office: 1,075 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 9/005 Statistical coding, e.g. Huffman, run length coding
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/423 characterised by memory arrangements H04N19/433 takes precedence
• CPC Class Codes: H04N 19/436 using parallelised computational arrangements
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 9/64 Circuits for processing colour signals H04N9/77 takes precedence; camera processing pipelines for processing colour signals H04N23/84

Abstract

The disclosure herein relates to devices for compression, decompression or reconstruction of image data for still or moving pictures, such as image data detected with a digital camera. In some embodiments, data channels are compressed using a scalable compression algorithm. The compression algorithm may allow customization of compression parameters, such as a quantization factor, code block size, number of transform levels, reversible or irreversible compression, a desired compression ratio with a variable bit rate output, a desired fixed bit rate output with a variable compression rate, progression order, output format, or visual weighting. A lower quality image or an image with lower resolution may be reconstructed using only some of the compressed data. Use of offsets to various layers and color channels allow reconstruction of the image without requiring decompression of all of the full image data.

Claims

1. An imaging device, comprising:

a color filter array configured to filter light and comprising a plurality of filter elements arranged in a repeating pattern;

at least one image sensor configured to obtain a plurality of image frames in a motion video image sequence, the image frames in the plurality of image frames comprising image data corresponding to a plurality of data channels relating to light passing through the color filter array, the data channels including a red color channel, a blue color channel, a first green color channel, and a second green color channel;

image handling electronics configured to;

compress the image data with an algorithm that provides compressed image data corresponding to at least first and second quality levels corresponding to first and second resolutions,

wherein a first portion of the compressed image data is usable to display a first image frame of the plurality of image frames at the first quality level without accessing any of the compressed image data corresponding to quality levels higher than the first quality level,

further wherein a second portion of the compressed image data is usable together with the first portion to reconstruct the first image frame at a second quality level higher than the first quality level,

the image handling electronics further configured to;

organize the compressed image data in the first portion for the red, blue, and first green color channels together in one or more first groups;

organize the compressed image data in the first portion for the second green color channel separately from the one or more first groups;

organize the compressed image data in the second portion for the red, blue, and first green color channels together in one or more second groups;

organize the compressed image data in the second portion for the second green color channel separately from the one or more second groups; and

create and electronically store an index including a plurality of location references usable to access the compressed image data on a storage device.

2. The imaging device of claim 1, wherein the image handling electronics are further configured to store the one or more first groups together on the storage device and to store the one or more second groups together on the storage device.

3. The imaging device of claim 2, wherein the one or more first groups reside in substantially contiguous memory space on the storage device and the one or more second groups reside in substantially contiguous memory space on the storage device.

4. The imaging device of claim 1, wherein the second portion is usable together with the first portion to reconstruct the first image frame at the second quality level without accessing any of the compressed image data corresponding to any quality level higher than the second quality level.

5. The imaging device of claim 1, wherein the compressed image data in the first portion for the second green color channel is stored separately on the memory device from the first group, and the compressed image data in the second portion for the second green color channel is stored separately on the memory device from the second group.

6. The imaging device of claim 1, wherein

for each of the one or more first groups, the compressed image data for the red, blue, and first green color channel share a common one of the plurality of location references, and

for each of the one or more second groups, the compressed image data for the red, blue, and first green color channel share a common one of the plurality of location references.

7. The imaging device of claim 1, wherein

for each of the one or more first groups, the compressed image data for each of the red, blue, and first green color channels has a separate location reference of the plurality of location references, and

for each of the one or more second groups, the compressed image data for each of the red, blue, and first green color channels has a separate location reference of the plurality of location references.

8. A method of storing color image data, comprising:

electronically obtaining image data corresponding to a first image frame, the image data including a plurality of data channels corresponding to light passing through a color filter array onto one or more electronic image sensors, the plurality of data channels including a first green color channel, a second green color channel, and at least one non-green color channel;

using electronics comprising digital logic circuitry;

compressing the image data with an algorithm that provides compressed image data corresponding to at least first and second quality levels each corresponding to a different resolution, wherein a first portion of the compressed image data is usable to display the first image frame at the first quality level without accessing any of the compressed image data corresponding to quality levels higher than the first quality level, further wherein a second portion of the compressed image data is usable together with the first portion to reconstruct the first image frame at a second quality level higher than the first quality level;

organizing the compressed image data in the first portion for at least the first green color channel and the non-green color channel together in one or more first groups that do not include the second green color channel;

organizing the compressed image data in the first portion for the second green color channel separately from the one or more first groups;

organizing the compressed image data in the second portion for at least the first green color channel and the non-green color channel together in one or more second groups that do not include the second green color channel;

organizing the compressed image data in the second portion for the second green color channel separately from the one or more second groups; and

creating and electronically storing an index including a plurality of location references usable to access the compressed image data on a storage device.

9. The method of claim 8, further comprising storing the one or more first groups together on the storage device and storing the one or more second groups together on the storage device.

10. The method of claim 9, wherein the one or more first groups reside in substantially contiguous memory space on the storage device and the one or more second groups reside in substantially contiguous memory space on the storage device.

11. The method of claim 8, wherein the compressed image data in the first portion for the second green color channel is stored separately on the memory device from the first group, and the compressed image data in the second portion for the second green color channel is stored separately on the memory device from the second group.

12. The method of claim 8, wherein

for each of the one or more first groups, the compressed image data for the red, blue, and first green color channel share a common one of the plurality of location references, and

for each of the one or more second groups, the compressed image data for the red, blue, and first green color channel share a common one of the plurality of location references.

13. The method of claim 8, wherein

for each of the one or more first groups, the compressed image data for each of the red, blue, and first green color channels has a separate location reference of the plurality of location references, and

for each of the one or more second groups, the compressed image data for each of the red, blue, and first green color channels has a separate location reference of the plurality of location references.