Optical image stabilization for thin cameras

• US 9,832,381 B2
• Filed: 09/08/2015
• Issued: 11/28/2017
• Est. Priority Date: 10/31/2014
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Osborne, Thomas Wesley
• Primary Examiner(s): Giles, Nicholas
• Application Number:
  US14/848,127
• Publication Number:
  US 20160127646A1
• Time in Patent Office: 812 Days
• CPC Class Codes: G02B 27/646 compensating for small deviations, e.g. due to vibration or shake movement of one or more optical elements for control of motion blur in cameras, projectors or printers G03B2205/0007; image stabilisation in cameras peculiar to the presence or use of an electronic image sensor H04N23/68
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/687 by shifting the lens or sensor position
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

Systems and methods for optical image stabilization of thin cameras are disclosed. An image stabilization system for a camera system includes a stabilization platform configured to support a camera system, a camera housing, a fulcrum rotationally and pivotally connecting the stabilization platform to the camera housing, the fulcrum configured such that the stabilization platform can tilt and rotate relative to the camera housing in at least one of the pitch, roll, and yaw directions, at least one gyroscope rigidly connected to the stabilization platform, and at least one actuator coupled to the stabilization platform and configured to cause tilting or rotation of the stabilization platform in at least one of the pitch, roll, and yaw directions.

Claims

1. An image stabilization system for a camera system, comprising:

a stabilization platform configured to support a parallax free camera system including an array of at least two cameras each configured to capture a corresponding portion of at least two portions of an image, the array having a virtual optical axis defined by optical paths of the at least two cameras;

a camera housing;

a fulcrum rotationally and pivotally connecting the stabilization platform to the camera housing and aligned with the virtual optical axis, the fulcrum configured such that the stabilization platform can tilt and rotate relative to the camera housing in at least one of a pitch direction, a roll direction, and a yaw direction;

at least one gyroscope rigidly connected to the stabilization platform to move with the stabilization platform; and

at least one actuator directly coupled to the stabilization platform and configured to cause tilting or rotation of the stabilization platform in at least one of the pitch direction, the roll direction, and the yaw direction.

2. The image stabilization system of claim 1, wherein the at least one gyroscope is configured to generate motion data, the image stabilization system further comprising a processor in electronic communication with the at least one gyroscope and the at least one actuator, the processor configured to:

receive the generated motion data from the at least one gyroscope;

determine, based on analyzing the motion data, that the camera system is experiencing jitter;

generate motion instructions for the at least one actuator, the motion instructions configured to compensate for one or both of a frequency and a magnitude of the jitter; and

provide the motion instructions to the actuator.

3. The image stabilization system of claim 1, wherein the at least one gyroscope includes a first, second, and third gyroscope, and wherein the at least one actuator comprises:

a first actuator configured to rotate the stabilization platform in the yaw direction;

a second actuator configured to tilt the stabilization platform in the pitch direction;

and

a third actuator configured to tilt the stabilization platform in the roll direction,

wherein the first, second, and third gyroscopes are each positioned in a blind spot relative to the camera system to facilitate removing at least a portion of one or more of the first, second, and third gyroscopes from a captured image.

4. The image stabilization system of claim 1, wherein the fulcrum comprises a ball bearing.

5. The image stabilization system of claim 1, wherein the fulcrum comprises a fulcrum point, and wherein the fulcrum point is aligned with an optical axis of the camera system.

6. The image stabilization system of claim 1, wherein the camera system comprises an array camera.

7. The image stabilization system of claim 1, wherein the stabilization platform is configured to rotate in each of the pitch direction, the roll direction, and the yaw direction.

8. The image stabilization system of claim 1, wherein the stabilization platform is configured to not substantially obstruct a field of view of the camera system.

9. The image stabilization system of claim 1, wherein the stabilization platform comprises a substantially flat plate.

29. The image stabilization system of claim 2, wherein:

the motion data generated by the at least one gyroscope comprises an orientation data and a movement data of at least one of the stabilization platform and the camera system; and

generating the motion instructions for the at least one actuator is based at least in part on the generated motion data.

30. The image stabilization system of claim 2, the processor further configured to:

prior to generating the motion instructions, analyze the motion data generated by the at least one gyroscope to determine whether the jitter is present; and

in response to determining that the jitter is present, determine the one or both of the frequency and the magnitude of the jitter.

10. An image stabilization system for an array camera, comprising:

a parallax free array camera having a virtual optical axis, the array camera comprising at least two cameras, each of the at least two cameras configured to capture one of a plurality of portions of a target image of a scene, the array camera having a virtual optical axis defined by optical paths of the at least two cameras;

a support structure supporting the array camera;

a pivot member rigidly connected to the support structure, the pivot member configured to pivot in a yaw direction, a pitch direction, and a roll direction around a center of the pivot member, the center of the pivot member aligned with the virtual optical axis of the array camera;

at least one gyroscope rigidly connected to the support structure to move with the support structure, the at least one gyroscope configured to generate motion data, the motion data indicative of a motion of the support structure; and

an actuator directly coupled to the support structure, the actuator configured to receive motion instructions and to rotate the support structure in the yaw direction, the pitch direction, and the roll direction around the center of the pivot member in response to the received motion instructions.

11. The image stabilization system of claim 10, further comprising:

a processor in electronic communication with the at least one gyroscope and the actuator, the processor configured to;

receive the motion data from the at least one gyroscope;

determine, based on analyzing the motion data, that the array camera is experiencing jitter;

generate the motion instructions for the actuator, the motion instructions configured to compensate for one or both of a frequency and a magnitude of the jitter; and

provide the motion instructions to the actuator.

12. The image stabilization system of claim 11, further comprising a housing, wherein the housing comprises:

an internal cavity, wherein the support structure and the array camera are disposed within the internal cavity; and

an aperture positioned to allow light representing the target image to pass through the aperture and into the internal cavity of the housing and to reach each of the at least two cameras,

wherein the actuator is further coupled to the housing and further configured to pivot the support structure in the yaw direction, the pitch direction, and the roll direction relative to the housing.

13. The image stabilization system of claim 10, wherein the pivot member is a ball bearing.

14. The image stabilization system of claim 10, wherein the support structure comprises a plate, wherein the plate is substantially flat.

15. The image stabilization system of claim 14, wherein the pivot member is disposed on a bottom surface of the plate and the array camera is disposed on a top surface of the plate.

16. The image stabilization system of claim 14, further comprising:

a first gyroscope disposed on a first corner of the plate;

a second gyroscope disposed on a second corner of the plate;

a third gyroscope disposed on a third corner of the plate; and

wherein the first gyroscope, the second gyroscope, and the third gyroscope are each positioned in a blind spot relative to each of the at least two cameras.

17. The image stabilization system of claim 10, wherein each of the at least two cameras of the array camera each comprise:

an image sensor;

a lens assembly comprising at least one lens, the lens assembly having a center of projection, the lens assembly positioned to focus light on the image sensor; and

a mirror positioned to reflect light to the lens assembly, the mirror further positioned on a mirror plane, the mirror plane positioned at a midpoint of and orthogonal to a line segment extending between the center of projection and a virtual center of projection.

18. The image stabilization system of claim 17, wherein the array camera further comprises a central reflective element having a plurality of primary light re-directing surfaces configured to split the light into the plurality of portions, wherein the mirror of each of the at least two cameras forms one of the primary light re-directing surfaces.

19. The image stabilization system of claim 17, wherein the support structure comprises a substantially flat plate, and wherein each of the at least two cameras further comprises a re-directing surface positioned to direct light from the lens assembly onto the image sensor, and wherein the image sensors of each of the at least two cameras are disposed on an upper surface of the substantially flat plate and positioned substantially parallel with the upper surface of the substantially flat plate.

20. The image stabilization system of claim 12, wherein the at least one gyroscope is disposed on the housing.

21. A method for stabilizing images formed by a parallax free array camera system supported by a stabilization platform on a fulcrum, the array camera system having a virtual optical axis defined by optical paths of at least two cameras in the array camera system and the fulcrum aligned with the virtual optical axis, the method comprising:

receiving motion data at a processor, the motion data generated by at least one gyroscope in electronic communication with the processor, the at least one gyroscope mounted on the stabilization platform;

analyzing the motion data with the processor to determine that the camera system is experiencing jitter;

generating instructions for an actuator to compensate for one or both of a frequency and magnitude of the jitter;

providing the instructions to the actuator; and

moving the stabilization platform supporting the camera system with the actuator in response to the instructions, the actuator being directly coupled to the stabilization platform.

22. The method of claim 21, wherein moving the stabilization platform comprises pivoting the stabilization platform in a pitch direction, a yaw direction, and a roll direction around a center point of a fulcrum rigidly attached to the stabilization platform, the center point aligned with an optical axis of the camera system.

23. The method of claim 22, wherein the actuator comprises a first linear actuator configured to pivot the stabilization platform in a pitch direction, a second linear actuator configured to pivot the stabilization platform in a yaw direction, and a third linear actuator configured to pivot the stabilization platform in a roll direction.

24. The method of claim 23, wherein the camera system comprises an array camera including at least two cameras, and wherein each of the cameras comprise:

an image sensor;

a lens assembly comprising at least one lens, the lens assembly having a center of projection, the lens assembly positioned to focus light on the image sensor; and

a mirror positioned to reflect light to the lens assembly, the mirror further positioned on a mirror plane, the mirror plane positioned at a midpoint of and orthogonal to a line segment extending between the center of projection and a virtual center of projection.

25. The method of claim 22, wherein the stabilization platform comprises a substantially flat plate.

26. The method of claim 23, wherein the fulcrum comprises a ball bearing mounted to a bottom surface of the stabilization platform.

27. The method of claim 21, wherein the method further comprises repeating each of the receiving, analyzing, generating, providing, and moving in a feedback loop.

28. The method of claim 21, wherein the image motion data is generated by comparing successively captured images.

31. The method of claim 21, wherein moving the stabilization platform comprises

moving the stabilization platform using the actuator to cause the stabilization platform to pivot around a fulcrum point in space, the fulcrum point in space not including any physical structure.