IMAGE ACQUISITION METHOD AND APPARATUS WITH MEMS OPTICAL IMAGE STABILIZATION (OIS)

• US 20150103190A1
• Filed: 10/16/2014
• Published: 04/16/2015
• Est. Priority Date: 10/16/2013
• Status: Abandoned Application

• Current Assignee: FotoNation Limited (Adeia, Inc.)
• Original Assignee: DigitalOptics Corporation Europe Limited (Adeia, Inc.)
• Inventors: Corcoran, Peter, Drimbarean, Alexandru, Zamfir, Adrian, Bigioi, Petrenol, Florean, Corneliu
• Application Number:
  US14/516,030
• Publication Number:
  US 20150103190A1
• Time in Patent Office: Days
• US Class Current: 348/208.2
• CPC Class Codes: G02B 27/646 compensating for small deviations, e.g. due to vibration or shake movement of one or more optical elements for control of motion blur in cameras, projectors or printers G03B2205/0007; image stabilisation in cameras peculiar to the presence or use of an electronic image sensor H04N23/68
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/675 comprising setting of focusing regions
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/685 performed by mechanical compensation
• CPC Class Codes: H04N 23/687 by shifting the lens or sensor position
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio

Abstract

An image acquisition sensor of a digital image acquisition apparatus is coupled to imaging optics for acquiring a sequence of images. Images acquired by the sensor are stored. A motion detector causes the sensor to cease capture of an image when the degree of movement in acquiring the image exceeds a threshold. A controller selectively transfers acquired images for storage. A motion extractor determines motion parameters of a selected, stored image. An image re-constructor corrects the selected image with associated motion parameters. A selected plurality of images nominally of the same scene are merged and corrected by the image re-constructor to produce a high quality image of the scene.

Claims

1. A digital image acquisition apparatus, comprising:

an image acquisition sensor coupled to imaging optics for acquiring a sequence of images;

an image store for storing images acquired by said sensor;

an optical image stabilization sub-system to optically compensate for device motion during image acquisition up to a pre-determined motion threshold;

a motion detector for causing said sensor to cease capture of an image when a degree of movement in acquiring said image exceeds a threshold;

a controller for selectively transferring said image acquired by said sensor to said image store and resetting said image sensor and re-aligning the imaging optics with a main optical axis; and

an image merger for merging a selected plurality of images nominally of a same scene to produce a high quality image of said scene.

2. An apparatus as claimed in claim 1, wherein the motion detector determines an angular displacement of the imaging optics from the main optical axis and wherein capture of an image ceases when said displacement exceeds a pre-determined threshold.

3. An apparatus as claimed in claim 2, wherein said pre-determined threshold lies in a range of 0.5-1.0 degrees.

4. An apparatus as claimed in claim 3, wherein said optical image stabilization sub-system incorporates a 40 MEMS lens assembly.

5. An apparatus as claimed in claim 1, wherein said image store comprises a temporary image store, and wherein said apparatus further comprises a non-volatile memory, said image merger being configured to store said high quality image in said non-volatile memory.

6. An apparatus as claimed in claim 1, wherein said motion detector comprises a gyrosensor or an accelerometer, or both.

7. A digital image acquisition apparatus, comprising:

an image acquisition sensor coupled to imaging optics for acquiring a sequence of images;

an image store for storing images acquired by said sensor;

a motion detector for causing said sensor to cease capture of an image when a degree of movement in acquiring said image exceeds a first threshold;

one or more controllers that causes the sensor to restart capture when the degree of movement is less than a given second threshold and that selectively transfers said image acquired by said sensor to said image store;

a motion extractor for determining motion parameters of a selected image stored in said image store;

an image re-constructor for correcting a selected image with associated motion parameters; and

an image merger for merging a selected plurality of images nominally of the same scene and corrected by said image re-constructor to produce a high quality image of said scene.

8. An apparatus as claimed in claim 7, further comprising a first exposure timer for storing an aggregate exposure time of a sequence of images, and wherein said apparatus is configured to acquire said sequence of images until the aggregate exposure time of at least a stored number of said sequence of images exceeds a predetermined exposure time for said high quality image.

9. An apparatus as claimed in claim 8, further comprising a second timer for storing an exposure time for a single image, and wherein said apparatus is configured to dispose of an image having an exposure time less than a threshold time.

10. An apparatus as claimed in claim 8, further comprising an image quality analyzer for a single image, and wherein said apparatus is configured to dispose of an image having a quality less than a given threshold quality.

11. An apparatus as claimed in claim 7, wherein said image merger is configured to align said selected plurality of images prior to merging said images.

12. An apparatus as claimed in claim 7, wherein said first and second thresholds comprise threshold amounts of motion energy.

13. An auto focus camera module, comprising:

a camera module housing defining an aperture and an internal cavity to accommodate camera module components;

an image sensor coupled to or within the housing;

a lens barrel within the housing that contains an optical train including at least one movable lens disposed relative to the aperture and image sensor to focus images of scenes onto the image sensor along an optical path; and

a fast focus MEMS actuator coupled to one or more lenses of the optical train including the at least one movable lens and configured to rapidly move said at least one movable lens relative to the image sensor to provide autofocus for the camera module in each frame of a preview or video sequence or both.

14. The camera module of claim 13, wherein the fast focus MEMS actuator is configured to reliably refocus within approximately 33 ms.

15. The camera module of claim 13, comprising a face tracking module that is configured to predict a location of a face region of interest in a future frame permitting the auto focus camera module to focus on the region of interest quickly.

16. The camera module of claim 13, comprising a face detection module that is configured to apply multiple short classifier chains in parallel to one or more windows of an image frame.

17. The camera module of claim 13, wherein the actuator is configured to alternately auto focus on two or more regions of interest, such that each region of interest is refocused every respective two or more frames of the preview or video sequence or both.

18. The camera module of claim 13, wherein the two or more regions of interest comprise two or more sub-regions of a face.

19. The camera module of claim 13, comprising a face recognition module that is configured to identify and prioritize one or more faces that correspond to one or more specific persons.