Method and system for image pre-processing

• US 20080158375A1
• Filed: 12/29/2006
• Published: 07/03/2008
• Est. Priority Date: 12/29/2006
• Status: Active Grant

• Current Assignee: WSOU Investments, LLC (WSOU Holdings, LLC)
• Original Assignee: Nokia Corporation
• Inventors: Kalevo, Ossi, Kakkori, Hannu
• Granted Patent: US 7,973,823 B2
• Time in Patent Office: Days
• US Class Current: 348/222.1
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining

Abstract

An imaging architecture has a memory module to store raw images for the pre-processing stage. The raw image from the output of the pre-processing block may be compressed by a compressor before the image is stored in the memory module. Furthermore, the raw image in the memory is subject to pre-processing as many times as needed or desired. Thus, a decompressor may be operatively connected to the memory module to retrieve the stored image and to decompress the retrieved image before providing the image to the pre-processing block. In the imaging architecture, a loop formed by the memory module, the decompressor, the pre-processing block and the compressor allows the image to be pre-processed multiple times. The imaging architecture can be coupled to the main processor and post-processor in an imaging device for further processing the image data for display or for transmission.

Claims

1. A method for pre-processing image data, comprising:

storing an image in a memory module;

coupling a pre-processing module to the memory module to form a processing loop, wherein the pre-processing module is operatively connected to a plurality of pre-processing parameter sets; and

conveying the image from the memory module to the pre-processing module via the loop so as to allow the pre-processing module to pre-process the image in multiple times, wherein the parameter sets used for pre-processing in at least some of the multiple times are different from the parameter sets used for pre-processing in other of the multiple times.

2. The method of claim 1, further comprising:

compressing the image for providing an compressed image before storing the image in the memory module;

retrieving the compressed image from the memory module; and

decompressing the retrieved image before conveying the image to the pre-processing module.

3. The method of claim 1, wherein the image stored in the memory module comprises a raw image.

4. The method of claim 1, further comprising

further pre-processing the image in a memory-to-memory operation separately from the pre-processing via the loop.

5. An image pre-processing module, comprising:

a memory module for storing at least an image; and

a pre-processor coupled to the memory module to form a loop, wherein the pre-processing module is operatively connected to a plurality of pre-processing parameter sets, and wherein the loop is configured for conveying the image from the memory module to the pre-processing module via the loop so as to allow the pre-processing module to pre-process the image in multiple times, wherein the parameter sets used for pre-processing in at least some of the multiple times are different from the parameter sets used for pre-processing in other of the multiple times.

6. The module of claim 5, further comprising:

a compressor, operatively connected to the memory module for compressing the image before the image is stored in the memory module; and

a decompressor, operatively connected to the pre-processor, for decompressing the image before conveying the image to the pre-processing module.

7. The module of claim 5, further comprising:

a further pre-processing module, coupled to the memory module, for further preprocessing the image in a memory-to-memory operation.

8. An image processing architecture for use in pre-processing a provided image, comprising:

a compressor module, adapted to compress the provided image for providing a compressed image;

a memory module for storing the compressed image;

a decompressor module, adapted to retrieve the stored image from the memory module for providing a decompressed image; and

a pre-processing module, coupled to decompressor module, for receiving the decompressed image, wherein the compressor module, the memory module, the decompressor module and pre-processing module are arranged to form a loop, and the pre-processing module is operatively connected to a plurality of pre-processing parameter sets, so as to allow the pre-processing module to pre-process the stored image in multiple times, wherein the parameter sets used for pre-processing in at least some of the multiple times are different from the parameter sets used for pre-processing in other of the multiple times.

9. The image processing architecture of claim 8, further comprising:

a further processing module, operatively coupled to the pre-processing module, for further processing the provided image after the provided image is compressed, stored, decompressed, and processed in the pre-processing module multiple times.

10. The image processing architecture of claim 9, wherein said further processing comprises color filter array interpolation and white balance processing.

11. The image processing architecture of claim 8, wherein the decompressor module is configured for receiving the provided image, wherein the decompressor module is operable in a bypass mode for conveying the provided image to the pre-processing module as received, and the pre-processing module is operable in a bypass mode for sending to the compressor module the provided image as conveyed from the decompressor module, so as to allow the compressor module to compress the provided image as received.

12. An imaging device comprising:

a mechanism for acquiring an image;

a memory module for storing the image;

a pre-processor coupled to the memory module to form a loop, wherein the pre-processing module is operatively connected to a plurality of pre-processing parameter sets, and wherein the loop is configured for conveying the image from the memory module to the pre-processing module via the loop so as to allow the pre-processing module to pre-process the image in multiple times, wherein the parameter sets used for pre-processing in at least some of the multiple times are different from the parameter sets used for pre-processing in other of the multiple times.

13. The imaging device of claim 12, further comprising:

a compressor, operatively connected to the memory module for compressing the image before the image is stored in the memory module; and

a decompressor, operatively connected to the pre-processor, for decompressing the image before conveying the image to the pre-processing module.

14. The imaging device of claim 12, wherein the mechanism comprises an image sensor for acquiring the image.

15. The imaging device of claim 14, further comprising imaging optics for forming an image on the image sensor.

16. The imaging device of claim 12, wherein the mechanism comprises a receiver for receiving image data of the image.

17. The imaging device of claim 12, wherein the pre-processor is configured for providing pre-processed data, said device further comprising:

a main processing module, coupled to the pre-processor, for receiving the pre-processed data.

18. The imaging device of claim 17, wherein the main processing module is configured for providing further processed image data, said imaging device further comprising:

a post-processor, coupled to the main processing module, for receiving the further processed image data.

19. The imaging device of claim 18, wherein the post-processing module is configured for providing post-processed image data, said imaging device further comprising:

a display, coupled to the post-processing module, for receiving the post-processed image data.

20. The imaging device of claim 18, wherein the post-processing module is configured for providing post-processed image data, said imaging device further comprising:

a transmitting module, coupled to the post-processing module, for receiving the post-processed image data for transmission.

21. The imaging device of claim 17, wherein the main processing module is configured for providing further processed image data, said imaging device further comprising:

a transmission module, coupled to the main processing module, for receiving the further processed image data for transmission.

22. The imaging device of claim 12, further comprising:

a further processing module, operatively coupled to the pre-processing module, for further processing the provided image after the provided image is compressed, stored, decompressed, and processed in the pre-processing module multiple times.

23. The imaging device of claim 12, comprising a digital camera.

24. The imaging device of claim 12, comprising a mobile phone.