Method, Apparatus, Software and Arrangement for Modifying Image Data

• US 20080303912A1
• Filed: 11/14/2005
• Published: 12/11/2008
• Est. Priority Date: 11/18/2004
• Status: Active Grant

• Current Assignee: Beijing Xiaomi Mobile Software Co., Ltd. (Xiaomi Corp.)
• Original Assignee: Nokia Corporation
• Inventors: Ahonen, Petri
• Granted Patent: US 8,077,208 B2
• Time in Patent Office: Days
• US Class Current: 348/222.1
• CPC Class Codes: H04N 23/673 based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/72 Combination of two or more compensation controls
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof

Abstract

This invention relates to programmable modification of image data of a small compact digital camera. In the method according to the embodiments of the invention sensor data is processed before transferring it to an image processing component. The sensor data is read out from a camera sensor several times during one total exposure time and a data entity representing the final picture is integrated from the sensor data read out during an individual exposure time. The sensor data and/or the data entity are analyzed before the data entity is transferrable to the image processing component.

Claims

1. A method for processing sensor data before transferring it to an image processing component, characterized in that sensor data is read out from a camera sensor during an individual exposure time and a data entity representing the final picture is integrated from the sensor data read out during the total exposure time such that the read sensor data and/or integrated data entity is analyzed before the data entity is transferable to the image processing component.

2. A method according to claim 1, characterized in that the sensor data is read out at a high frequency at least two or more times during the total exposure time.

3. A method according to claim 1, characterized in that the sensor data is read out at a high frequency such that the ratio of frequencies of the total exposure time and an individual exposure time, during which the sensor data is read, is of the order of 1:

10, 1;

100, 1;

1000 or 1;

10000.

4. A method according to claim 1, characterized in that the sensor data read out during the total exposure time is converted to digital form and integrated into one data entity, after which the integrated, digital data entity is analyzed before transferring it to the image processing component.

5. A method according to claim 1, characterized in that during the total exposure time the data entity is analyzed such that exposure adjustment is examined and the exposure time is determined based on the analysis performed.

6. A method according to claim 5, characterized in that exposure adjustment is examined over the entire sensor area, over the area of an individual pixel or over an area of specified pixels.

7. A method according to claim 1, characterized in that the read sensor data is converted to digital form and the digital sensor data is analyzed before the sensor data is integrated into the data entity.

8. A method according to claim 1, characterized in that during the total exposure time, in case the motion sensor indicates a camera movement, the digital data entity is shifted to a direction opposite to the indicated camera movement for eliminating blurring caused by the movement in the final picture to be composed of the data entity.

9. A method according to claim 1, characterized in that the focusing distance and object are changed during the total exposure time such that focusing information is achieved for various distances.

10. A method according to claim 9, characterized in that the focusing information of the object contained in the final picture is included in the data entity to be transferred to the image processing component, whereby each object is accurately imaged irrespective of the object distance.

11. A method according to claim 1, characterized in that during the total exposure time an offset is caused in the sensor or in the photographing apparatus such that a larger image field is exposed during the total exposure time than the one corresponding to the sensor size.

12. A method according to claim 11, characterized in that the read sensor data includes more detailed information on the center area common to various offset positions and additional information on the edge area specific for each offset position.

13. A method according to claim 11, characterized in that the sensor data read out during the total exposure time is integrated into a data entity for composing a picture that includes a wider image field than the normal image field of the sensor.

14. A method according to claim 11, characterized in that the data entity is integrated from the information, concerning the sensor center area, common to the sensor data read out during the total exposure time, for composing a picture whose resolution is higher than the sensor resolution.

15. A method according to claim 1, characterized in that the data entity produced during the total exposure time is transferred to an external memory, in which the final picture is composed of at least two or more data entities by integrating the data entities into an integral picture.

30. Software for processing sensor data before transferring it to an image processing component, characterized in that it comprises programmable means for carrying out the methods according to claim 1.

16. An apparatus for processing sensor data before transferring it to an image processing component, characterized in that it comprises means for reading out the sensor data of a camera sensor during an individual exposure time, means for analyzing the read sensor data, means for integrating the data entity representing the final picture from the sensor data read out during the total exposure time, and means for analyzing the data entity.

17. An apparatus according to claim 16, characterized in that it comprises means for reading out the sensor data at least two or more times during the total exposure time.

18. An apparatus according to claim 16, characterized in that it comprises means for reading out the sensor data of the order of 10, 100, 1000 or 10000 times during the total exposure time.

19. An apparatus according to claim 16, characterized in that it comprises means for converting the read sensor data to digital form, for analyzing the digital sensor data and for integrating the analyzed digital sensor data into the data entity.

20. An apparatus according to claim 16, characterized in that it comprises a motion sensor for indicating the camera movement and means for shifting the digital data entity to a direction opposite to the indicated camera movement for eliminating blurring caused by the movement from the final picture to be composed of the data entity.

21. An apparatus according to claim 16, characterized in that it comprises means for analyzing the digital data entity created out of the sensor data.

22. An apparatus according to claim 16, characterized in that it comprises means for examining exposure adjustment of the sensor data and for determining the exposure value by analyzing the data entity during the total exposure time.

23. An apparatus according to claim 21, characterized in that is comprises means for examining exposure adjustment over the entire sensor area, over the area of an individual pixel or over an area of specified pixels.

24. An apparatus according to claim 16, characterized in that it comprises means for varying the focusing distance and object during the exposure stage for creating focusing information for various distances.

25. An apparatus according to claim 23, characterized in that it comprises means for including the focusing information of each object contained in the final picture in the data entity to be transferred to the image processing component for photographing each object accurately irrespective of the distance.

26. An apparatus according to claim 16, characterized in that it comprises means for causing a sway in the sensor or in the photographing apparatus during the total exposure time for exposing a larger image field than the one corresponding to the sensor size during the total exposure time.

27. An apparatus according to claim 25, characterized in that it comprises means for integrating the sensor data read out during the total exposure time into a data entity for composing a picture that includes a wider image field than the normal image field of the sensor.

28. An apparatus according to claim 25, characterized in that it comprises means for integrating the information, concerning the sensor center area, common to the sensor data read out during the total exposure time, into a data entity for composing a picture whose resolution is higher than the sensor resolution.

29. An apparatus according to claim 16, characterized in that at least part of the said means are programmable means.

31. A software component for processing sensor data before transferring it to an image processing component, characterized in that it comprises programmable means for reading out the sensor data of a camera sensor at least two or more times during one total exposure time, programmable means for analyzing the sensor data read out during an individual exposure time, programmable means for integrating the data entity representing the final picture from the sensor data read out during the total exposure time, and programmable means for analyzing the data entity.