Image stabilizer for a microcamera module of a handheld device, and method for stabilizing a microcamera module of a handheld device

• US 7,307,653 B2
• Filed: 10/19/2001
• Issued: 12/11/2007
• Est. Priority Date: 10/19/2001
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Dutta, Amit
• Primary Examiner(s): Villecco, John M.
• Application Number:
  US09/999,020
• Publication Number:
  US 20030076421A1
• Time in Patent Office: 2,244 Days
• Field of Search: 348/208.7, 348/208.8, 348/208.11, 348/208.99, 348/208.2, 348/208.4, 348/208.14, 348/208.13, 348/373, 348/374, 348/376, 348/208.5, 348/208.6, 250/208.1, 396/52, 396/53, 396/54, 396/55
• US Class Current: 348/208.7
• CPC Class Codes: H04N 2007/145 Handheld terminals
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/687 by shifting the lens or sensor position

Abstract

A method and a handheld device for stabilizing an image captured by an optical lens of a micro camera integral with the handheld device, which may, for example, be a mobile phone. Motion sensors sense motion of the device and are used to cause movement of the micro camera to substantially compensate for the sensed movement so as to maintain a steady, focussed image to be displayed by a display on the handheld device or elsewhere, such as a remote display. The micro camera is moved by one or more motion actuators which move the camera in a horizontal plane substantially perpendicular to an axis of the lens of the camera and/or move the camera so as to pivot the lens axis.

Claims

1. A handheld device comprising:

a module comprising an optical lens assembly having an optical lens, the optical lens configured to provide an image of an object, the module further comprising an image sensor positioned to receive the image of the object from the optical lens, the image sensor configured to generate an electronic signal corresponding to the received image;

a motion sensor comprising one of an accelerometer or a gyroscope configured to sense movement of at least the lens assembly and the image sensor and to generate a movement signal indicative of the movement of at least the lens assembly and the image sensor;

an actuator comprising first and second actuator assemblies configured to provide respective movements of the module in two substantially perpendicular directions; and

a controller operatively connected to the motion sensor and the actuator so as to receive from the motion sensor the movement signal and in response thereto to transmit a signal to the actuator to cause the module to move so as to substantially stabilize the image of the object formed on the image sensor by substantially correcting for the sensed movement of the lens assembly and the image sensor.

2. The handheld device of claim 1, further comprising a digital signal processor operatively connected to the image sensor for processing the electronic signal generated by the image sensor and for generating a processed electronic signal capable of driving a display to display the image of the object.

3. The handheld device of claim 2, further comprising a display operatively connected to the digital signal processor for displaying the image in response to receipt from the digital signal processor of the processed electronic signal.

4. The handheld device of claim 3, wherein the handheld device is a mobile phone.

5. The handheld device of claim 2, wherein the module comprise a camera module, wherein the actuator is configured so as to be capable of moving the camera module, and wherein the motion sensor senses movement of the camera module.

6. The handheld device of claim 2, further comprising a circuit board, wherein the motion sensor, the actuator, the controller, and the digital signal processor are each mounted directly on the circuit board, and the module is mounted on the actuator.

7. The handheld device of claim 1, wherein the optical lens assembly further comprises a means for causing the optical lens to focus on the object.

8. The handheld device of claim 1, wherein the handheld device is a mobile phone.

9. The handheld device of claim 1, wherein the optical lens has an optical axis, and wherein the actuator is configured so as to be capable of pivoting the optical axis of the optical lens by moving the module.

10. The handheld device of claim 9, wherein the handheld device is a mobile phone.

11. The handheld device of claim 9, wherein there are four actuators.

12. The handheld device of claim 1, wherein the optical lens has an optical axis, and wherein the actuator is configured so as to be capable of causing the module to move in a plane substantially perpendicular to the optical axis of the optical lens.

13. The handheld device of claim 12, wherein the handheld device is a mobile phone.

14. The handheld device of claim 1, wherein the optical lens has an optical axis, and wherein the actuator is configured so as to be capable of causing the module to move so as to pivot the optical axis of the optical lens, and to be capable of causing the module to move in a plane substantially perpendicular to the optical axis of the optical lens.

15. The handheld device of claim 14, wherein there are four actuators.

16. The handheld device of claim 12, wherein there are four actuators.

17. The handheld device of claim 12, wherein the actuator comprises first and second actuator assemblies arranged on opposing sides of the module, the first and second actuator assemblies configured to provide respective translations of the module in opposing directions in said plane, the actuator further comprising third and fourth actuator assemblies arranged on opposing sides of the module, the third and fourth actuator assemblies configured to provide respective translations of the module in opposing directions in said plane and substantially perpendicular to the translations of the first and second actuator assemblies.

18. The handheld device of claim 14, wherein the handheld device is a mobile phone.

19. The handheld device of claim 1, wherein two motion sensors are oriented so as to sense movement of at least the lens assembly and the image sensor in two substantially perpendicular directions.

20. The handheld device of claim 1, wherein there are four actuators.

21. The handheld device of claim 1, wherein each of the first and second actuator assemblies comprises one of a piezo actuator, a MEMS actuator, and a shaped memory alloy.

22. The handheld device of claim 1, further comprising a circuit board, wherein the motion sensor, the actuator, and the controller are each mounted directly on the circuit board, and the module is mounted on the actuator.

23. A method comprising:

when forming an image of an object on an image sensor with at least one lens, wherein the at least one lens and image sensor are incorporated in a camera module of a handheld device, sensing movement of the at least one lens and the image sensor with a motion sensor comprising one of an accelerometer or a gyroscope;

generating a movement signal indicative of the sensed movement of the at least one lens and the image sensor with the motion sensor; and

moving, by an actuator comprising first and second actuator assemblies configured to provide respective movements of the camera module in two substantially perpendicular directions, the camera module in response to the movement signal so as to substantially stabilize the image of the object formed on the image sensor by substantially correcting for the sensed movement of the at least one lens and the image sensor.

24. The method of claim 23, wherein the camera module is moved so as to pivot an optical axis of the at least one lens.

25. The method of claim 23, wherein the camera module is moved in a plane substantially perpendicular to an optical axis of the lens.

26. The method of claim 23, wherein the camera module is moved so as to pivot an optical axis of the lens and is moved in a plane substantially perpendicular to an optical axis of the lens.