Method and handheld device for obtaining an image of an object by combining a plurality of images

• US 20030076408A1
• Filed: 10/18/2001
• Published: 04/24/2003
• Est. Priority Date: 10/18/2001
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Dutta, Amit
• Application Number:
  US09/982,372
• Publication Number:
  US 20030076408A1
• Time in Patent Office: Days
• US Class Current: 348/61
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 1/3876 Recombination of partial images to recreate the original image
• CPC Class Codes: H04N 1/407 Control or modification of tonal gradation or of extreme levels, e.g. background level
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/6845 by combination of a plurality of images sequentially taken
• CPC Class Codes: H04N 23/70 Circuitry for compensating brightness variation in the scene
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors

Abstract

A method and handheld device for scanning an object and creating a complete image of the object, even under low light conditions. The handheld device contains a camera module and a motion sensor assembly. The handheld device is moved so that the camera module takes a plurality of images of an object. A motion sensor assembly in the handheld device detects motion of the handheld device and movement information from the motion sensor assembly is used to modify each of the plurality of images to remove distortions therein caused by movement of the camera module. The plurality of images are combined to generate a reconstructed image of the object. For taking images under low light conditions, each of the plurality of images are added together to generate a brightened image.

Claims

1. A handheld device for taking an image of an object comprising:

a camera module capable of focusing on and generating an electronic image signal corresponding to an image of the object;

a motion sensor for sensing movement of said camera module and for generating a movement signal indicative of the movement of said camera module; and

a transmitting means for transmitting the electronic image signal and the movement signal to a processing engine.

2. The handheld device of claim 1, further comprising a processing engine receiving the electronic image signal and the movement signal from the transmitting means, and for processing the electronic image signal in response to the movement signal to correct the image signal for movement of said camera module, and for combining a plurality of corrected image signals into an electronic image output signal corresponding to a single image of the object.

3. The handheld device of claim 1, wherein said motion sensor is capable of detecting movement of said camera module in at least two dimensions.

4. The handheld device of claim 3, wherein said motion sensor is capable of detecting movement of said camera module in three dimensions.

5. The handheld device of claim 4, wherein said motion sensor comprises a accelerometer.

6. The handheld device of claim 4, wherein said motion sensor comprises a gyroscope.

7. The handheld device of claim 2, wherein said motion sensor is capable of detecting movement of said camera module in three dimensions.

8. The handheld device of claim 2, further comprising a memory for storing a plurality of electronic image signals corresponding to a plurality of images of the object.

9. The handheld device of claim 2, wherein said processing engine is capable of combining a plurality of corrected image signals corresponding to a plurality of images taken of different portions of the object.

10. The handheld device of claim 2, wherein said processing engine is capable of combining a plurality of corrected image signals corresponding to a plurality of images taken of the object to result in a signal capable of producing an image of a higher quality than any of the single images.

11. The handheld device of claim 2, wherein said handheld device is a mobile phone.

12. The handheld device of claim 1 in combination with a processing engine located remotely from the handheld device, said processing engine receiving the electronic image signal and the movement signal from the transmitting means, and for processing the electronic image signal in response to the movement signal to correct the image signal for movement of said camera module, and for combining a plurality of corrected image signals into an electronic image output signal corresponding to a single image of the object.

13. The handheld device of claim 12, wherein said handheld device is a mobile phone.

14. A method for obtaining an image of an object with a handheld device containing a camera module and a motion sensor, said method comprising:

taking a plurality of images of the object with the camera module to generate an electronic image signal corresponding to each of the plurality of images taken;

storing the plurality of electronic image signals;

sensing movement of the camera module between the taking with the camera module of the plurality of images of the object;

generating a plurality of movement signals which are indicative of sensed movement of the camera module;

processing each of the plurality of electronic image signals in response to the movement signals to correct for movement of the camera module to generate a plurality of corrected electronic image signals; and

combining the plurality of corrected electronic image signals into an electronic output signal corresponding to a single image of the object.

15. The method of claim 14, wherein movement of the camera module in at least two dimensions is sensed.

16. The method of claim 15, wherein movement of the camera module in three dimensions is sensed.

17. The method of claim 14, wherein storing the plurality of electronic image signals, processing each of the plurality of electronic image signals, and combining the plurality of corrected electronic image signals is performed by the handheld device.

18. The method of claim 17, wherein the handheld device is a mobile phone.

19. The method of claim 14, wherein storing the plurality of electronic image signals, processing each of the plurality of electronic image signals, and combining the plurality of corrected electronic image signals is performed by a processor remote from the handheld device.

20. The method of claim 14, wherein in said combing step, a plurality of corrected image signals corresponding to a plurality of images taken of different portions of the object are combined.

21. The method of claim 14, wherein in said combing step, a plurality of corrected image signals corresponding to a plurality of images taken of the object are combined to result in a signal capable of producing an image of a higher quality than any of the single images.

22. The method of claim 14, further comprising displaying on a display of the handheld device an image in response to the electronic image output signal.

23. The method of claim 14, further comprising transmitting the electronic image output signal to a display remote from the handheld device and displaying on the display an image in response to the electronic image output signal.