Image stabilization with adaptive shutter control

• US 7,734,161 B2
• Filed: 04/19/2007
• Issued: 06/08/2010
• Est. Priority Date: 04/19/2007
• Status: Expired due to Fees

• Current Assignee: Avago Technologies General IP PTE Limited (Broadcom, Inc.)
• Original Assignee: Avago Technologies ECBU IP Singapore Pte Limited (Broadcom, Inc.)
• Inventors: Brosnan, Michael John, Schneider, Alexander, Wilson, Robert
• Primary Examiner(s): Koval, Melissa J
• Assistant Examiner(s): PARKER, AUTUMN H
• Application Number:
  US11/737,625
• Publication Number:
  US 20080260366A1
• Time in Patent Office: 1,146 Days
• Field of Search: 396 52- 55, 348/208.99, 348/208.1, 348/208.2, 348/208.4, 348/208.12, 348/208.16
• US Class Current: 396/55
• CPC Class Codes: H04N 23/68 for stable pick-up of the scene, e.g. compensating for camera body vibrations
• CPC Class Codes: H04N 23/681 Motion detection
• CPC Class Codes: H04N 23/73 by influencing the exposure time

Abstract

An apparatus to facilitate image stabilization with adaptive shutter control is described. An embodiment of the apparatus includes an image sensor, a movement detector, and a shutter controller. The movement detector is coupled to the image sensor. The shutter controller is coupled to the movement detector. The image sensor is configured to obtain image data. The movement detector is configured to obtain movement measurement information during a shutter period having a predetermined duration. The shutter controller is configured to adjust the shutter period of a shutter based on the movement measurement information. The shutter controls the time the image sensor is responsive to light incident on the image sensor. Embodiments of the apparatus provide a smaller and less costly implementation for image stabilization.

Claims

1. An apparatus to facilitate image stabilization with adaptive shutter control, the apparatus comprising:

an image sensor to obtain image data;

a movement detector coupled to the image sensor, the movement detector configured to obtain movement measurement information during a shutter period having a predetermined duration; and

a shutter controller coupled to the movement detector, the shutter controller configured to adjust the shutter period of a shutter based on the movement measurement information, wherein the shutter controls a time the image sensor is responsive to light incident on the image sensor by deactivating the shutter in response to a determination that the image sensor moves beyond a movement threshold and reactivating the shutter in response to a determination that the image sensor returns within the movement threshold.

2. The apparatus of claim 1 wherein the shutter controller is further configured to deactivate the shutter prior to expiration of the predetermined duration of the shutter period.

3. The apparatus of claim 1 wherein the movement detector is further configured to determine if the image sensor moves beyond a movement threshold.

4. The apparatus of claim 3 wherein the movement detector is further configured to determine if the image sensor moves beyond a maximum heading excursion, wherein the maximum heading excursion is larger than the movement threshold and represents a maximum movement of the image sensor that will be tolerated for a single image.

5. The apparatus of claim 3 wherein the movement detector is further configured to determine if the image sensor returns within the movement threshold prior to moving beyond a maximum heading excursion.

6. The apparatus of claim 1 wherein the movement detector is further configured to generate the movement measurement information based on the image data from the image sensor.

7. The apparatus of claim 1 wherein the image sensor is further configured to store an original image from at least a portion of the predetermined duration of the shutter period, and to store a replacement image from a subsequent reduced shutter period having a shorter duration than an original duration corresponding to the original image.

8. The apparatus of claim 1 wherein the movement detector is further configured to identify a plurality of separate exposure times for a single image based on the movement measurement information, and the image sensor is further configured to accumulate an image signal for the single image over the plurality of separate exposure times.

9. The apparatus of claim 1 further comprising a brightness controller coupled to the image sensor, the brightness controller configured to generate brightness information, wherein the shutter controller is further configured to deactivate the shutter in response to a determination that the brightness information exceeds a brightness threshold.

10. The apparatus of claim 9 wherein the brightness controller is further configured to perform contrast equalization on an image in response to a determination that the brightness information is below a brightness threshold.

11. A method for image stabilization, the method comprising:

activating a shutter of an image sensor at a commencement of a shutter period, the shutter period having a predetermined duration;

obtaining movement measurement information during the shutter period, the movement measurement information indicative of a movement of the image sensor; and

adjusting the shutter period based on the movement measurement information, wherein adjusting the shutter period comprises;

deactivating the shutter of the image sensor in response to a determination that the movement measurement information exceeds a movement threshold; and

reactivating the shutter of the image sensor in response to a determination that the movement measurement information returns within the movement threshold.

12. The method of claim 11 wherein adjusting the shutter period comprises deactivating the shutter of the image sensor prior to expiration of the predetermined duration of the shutter period.

13. The method of claim 11 further comprising deactivating the shutter of the image sensor in response to a determination that the movement measurement information exceeds a maximum heading excursion, wherein the maximum heading excursion is larger than the movement threshold and represents a maximum movement of the image sensor that will be tolerated for a single image.

14. The method of claim 11 further comprising:

generating an original image during at least a portion of the predetermined duration of the shutter period after activating and before deactivating the shutter of the image sensor, wherein at least some of the movement measurement information is based on image data obtained during the predetermined duration;

generating a replacement image after reactivating the shutter of the image sensor, wherein the replacement image is generated during a reduced shutter period; and

replacing the original image with the replacement image.

15. The method of claim 14 further comprising performing contrast equalization on the replacement image.

16. The method of claim 11 further comprising:

generating an original image during at least a portion of the predetermined duration of the shutter period after activating and before deactivating the shutter of the image sensor; and

modifying an exposure time of the original image after reactivating the shutter of the image sensor.

17. The method of claim 16 further comprising deactivating the shutter in response to expiration of a monitoring period after at least one modification of the exposure time of the original image.

18. A camera system with adaptive shutter control, the camera system comprising:

means for obtaining movement measurement information during a shutter period, the movement measurement information indicative of a movement of an image sensor;

means for adjusting the shutter period based on the movement measurement information;

means for deactivating the shutter of the image sensor in response to a determination that the movement measurement information exceeds a movement threshold; and

means for reactivating the shutter of the image sensor in response to a determination that the movement measurement information returns within the movement threshold.

19. The camera system of claim 18 further comprising:

means for identifying a plurality of independent movement periods within a single monitoring period, wherein the plurality of independent movement periods are identified by the movement measurement information of the image sensor within a movement threshold; and

means for accumulating an image signal for a single image over the plurality of independent movement periods.

20. The camera system of claim 18 further comprising:

means for storing an original image from a first portion of the shutter period; and

means for storing a replacement image from a second portion of the shutter period having a shorter duration than the first portion corresponding to the original image.