Digital camera device and methodology for distributed processing and wireless transmission of digital images

• US 8,212,893 B2
• Filed: 05/12/2008
• Issued: 07/03/2012
• Est. Priority Date: 06/08/1999
• Status: Expired due to Fees

• Current Assignee: RPX Corporation
• Original Assignee: VeriSign, Inc.
• Inventors: Kahn, Philippe R., Easwar, Venkat V., Kirani, Shekhar, Bodnar, Eric O., Kahn, Sonia Lee
• Primary Examiner(s): NGUYEN, LUONG TRUNG
• Application Number:
  US12/119,491
• Publication Number:
  US 20090033752A1
• Time in Patent Office: 1,513 Days
• Field of Search: None
• US Class Current: 348/234
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

A digital imaging system is described that provides techniques for reducing the amount of processing power required by a given digital camera device and for reducing the bandwidth required for transmitting image information to a target platform. The system defers and/or distributes the processing between the digital imager (i.e., digital camera itself) and the target platform that the digital imager will ultimately be connected to. In this manner, the system is able to decrease the actual computation that occurs at the digital imager. Instead, the system only performs a partial computation at the digital imager device and completes the computation somewhere else, such as at a target computing device (e.g., desktop computer) where time and size are not an issue (relative to the imager). By deferring resource-intensive computations, the present invention substantially reduces the processor requirements and concomitant battery requirements for digital cameras. Further, by adopting an image strategy optimized for compression (compressed luminosity record), the present invention decreases the bandwidth requirements for transmitting images, thereby facilitating the wireless transmission of digital camera images.

Claims

1. In a digital imaging system, a method for distributed digital image processing, the method comprising:

receiving compressed luminosity information at a device, the compressed luminosity information generated by a second device in a first set of data packets corresponding to a color image at a first level of photographic significance, wherein the compressed luminosity information is packaged with header information identifying individual bit planes that comprise the compressed luminosity information, and wherein the compressed luminosity information generated by the second device is packaged into a plurality of data packets suitable for progressive transmission of image data corresponding to varying levels of photographic significance;

restoring the luminosity information from the first set of data packets of compressed luminosity information;

converting the compressed luminosity information, corresponding to the transmitted data packets, into the color image at the first level of photographic significance;

receiving a second set of data packets generated by the second device corresponding to a higher level of photographic significance of the color image; and

converting the color image to a higher-quality representation by synchronizing the first set of data packets and the second set of data packets to obtain the color image at the higher level of photographic significance.

2. The method of claim 1, wherein the luminosity information comprises light-level information for representing an image that has been digitally captured at the device.

3. The method of claim 1, wherein generating the compressed luminosity information by comprises:

applying generic binary compression to the compressed luminosity information at the device.

4. The method of claim 3, wherein applying generic binary compression includes applying run-length encoding.

5. The method of claim 3, wherein applying generic binary compression includes applying Huffman coding.

6. The method of claim 1, wherein restoring includes reversing the compression that occurred at the device.

7. The method of claim 1, wherein converting the luminosity information into the color image includes:

interpolating color information for the color image from the luminosity information.

8. The method of claim 1, further comprising:

first receiving a lower-quality representation of the color image captured at the device.

9. The method of claim 8, wherein the lower-quality representation of the color image is converted into a higher-quality representation at a later point in time.

10. The method of claim 9, wherein the lower-quality representation of the image is converted into the higher-quality representation by synchronizing the lower-quality representation with the higher-quality representation.

11. In a digital imaging system, a method for deferring digital image processing, the method comprising:

receiving compressed sensor information progressively transmitted in a first set of data packets corresponding to a color image at a first level of photographic significance from a first device, the compressed sensor information compressed prior to color processing, wherein the compressed sensor information includes luminosity information for the compressed sensor information packaged with header information identifying individual bit planes that comprise the luminosity information, and wherein the luminosity information packaged by the first device into a plurality of data packets suitable for progressive transmission of image data corresponding to varying levels of photographic significance;

decompressing the compressed sensor information from the first set of data packets;

processing the compressed sensor information, corresponding to the decompressed first set of data packets, into the color image at the first level of photographic significance;

receiving a second set of data packets generated by the first device corresponding to a higher level of photographic significance of the color image; and

decompressing the second set of data packets to convert the color image to a higher-quality representation by synchronizing decompressed sensor information from the first set of data packets and decompressed sensor information from the second set of data packets to obtain the color image at the higher level of photographic significance.

12. The method of claim 11, wherein the sensor information comprises light-level information for representing an image that has been digitally recorded at the first device.

13. The method of claim 11, wherein the sensor information is compressed by:

applying a wavelet transform to the sensor information; and

applying compression to the transformed sensor information, to create the compressed sensor information at the first device.

14. The method of claim 13, wherein applying the compression to the transformed sensor information includes one of the following:

applying compression using run-length encoding and applying compression using Huffman coding.

15. The method of claim 11, further comprising:

converting the compressed sensor information into a color image by interpolating color information for an image from the compressed sensor information.

16. The method of claim 11, further comprising:

receiving a first lower-quality representation of an image recorded at the first device.

17. The method of claim 16, further comprising:

converting the lower-quality representation of the image into a higher-quality representation at a later point in time.

18. The method of claim 17, wherein the converting comprises synchronizing the lower-quality representation with the higher-quality representation.

19. An imaging system providing deferred image processing, the system comprising:

a communication link for receiving compressed luminosity information in a first set of data packets corresponding to a color image at a first level of photographic significance transmitted from an imager, the compressed luminosity information generated from luminosity information captured by the imager, wherein the compressed luminosity information is packaged with header information identifying individual bit planes that comprise the luminosity information, and wherein the compressed luminosity information transmitted from the imager are packaged into a plurality of data packets suitable for progressive transmission of image data corresponding to varying levels of photographic significance;

a decompression module for decompressing the compressed luminosity information from the first set of data packets, whereupon the decompressed luminosity information may thereafter be processed into the color image at the first level of photographic significance corresponding to the transmitted first set of data packets; and

in response to receipt of compressed luminosity information, corresponding to a higher level of photographic significance of the color image, in a second set of data packets transmitted by the imager, the decompression module for decompressing luminosity information in the second set of data packets to convert the color image to a higher-quality representation by synchronization of the decompressed luminosity information from the first set of data packets and decompressed luminosity information from the second set of data packets to obtain the color image at the higher level of photographic significance.

20. The system of claim 19, wherein the communication link first receives a lower-quality representation of an image captured at the imager, and wherein the lower-quality representation is converted into a higher-quality representation at a later point in time by synchronizing the lower-quality representation with the higher-quality representation.