Systems and methods for generating a bias for a camera sensor for increasing resolution of captured images

• US 10,560,641 B2
• Filed: 12/28/2017
• Issued: 02/11/2020
• Est. Priority Date: 12/28/2017
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Mayle, Douglas Michael
• Primary Examiner(s): Monk, Mark T
• Application Number:
  US15/856,531
• Publication Number:
  US 20190208137A1
• Time in Patent Office: 775 Days
• Field of Search: None
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 1/3935 with modification of image resolution, i.e. determining the values of picture elements at new relative positions
• CPC Class Codes: H04N 23/681 Motion detection
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 25/48 Increasing resolution by shifting the sensor relative to the scene
• CPC Class Codes: H04N 5/265 Mixing

Abstract

Systems, methods, and non-transitory computer readable media can provide a vibrating source configured to cause movement of a camera sensor to generate a bias for the camera sensor. A high frequency accelerometer configured to measure movement of the camera sensor can be provided. A plurality of images of a scene can be captured using the camera sensor based on the generated bias at a resolution supported by the camera sensor, wherein the high frequency accelerometer measures movement of the camera sensor during the capture of the plurality of images.

Claims

1. A system comprising:

a camera sensor of a camera configured to capture images;

a vibrating source, located in the camera, configured to generate movement of the camera sensor to generate a bias for the camera sensor; and

a high frequency accelerometer configured to measure movement of the camera sensor,

wherein the camera sensor captures a plurality of images of a scene based on the generated bias at a resolution supported by the camera sensor, wherein the vibrating source and the high frequency accelerometer are coupled to the camera sensor, and wherein the high frequency accelerometer measures movement of the camera sensor generated by the vibrating source during the capture of the plurality of images.

2. The system of claim 1, wherein the camera sensor includes one or more of:

a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

3. The system of claim 1, wherein the vibrating source is a spindle with a weight that is off center.

4. The system of claim 1, wherein the generated bias is a directional bias.

5. The system of claim 1, wherein the bias provides subpixel image data for a portion of an image captured by the camera sensor.

6. The system of claim 1, wherein a combined image having a higher resolution than the resolution supported by the camera sensor is generated based on the plurality of images and weights associated with the plurality of images.

7. The system of claim 6, wherein the weights associated with the plurality of images include a plurality of weights associated with each image of the plurality of images.

8. The system of claim 7, wherein, for a particular section of the combined image, a weight assigned to a portion of an image of the plurality of images that aligns with the particular section is higher than a weight assigned to a portion of an image of the plurality of images that does not align with the particular section.

9. The system of claim 7, wherein a weight assigned to a portion of an image of the plurality of images that includes the bias is higher than a weight assigned to a portion of the image that does not include the bias.

10. A computer-implemented method comprising:

providing a vibrating source configured to generate movement of a camera sensor of a camera to generate a bias for the camera sensor, wherein the vibrating source is located in the camera;

providing a high frequency accelerometer configured to measure movement of the camera sensor; and

capturing a plurality of images of a scene using the camera sensor based on the generated bias at a resolution supported by the camera sensor, wherein the vibrating source and the high frequency accelerometer are coupled to the camera sensor, wherein the high frequency accelerometer measures movement of the camera sensor generated by the vibrating source during the capture of the plurality of images.

11. The computer-implemented method of claim 10, wherein the camera sensor includes one or more of:

a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

12. The computer-implemented method of claim 10, wherein the vibrating source is a spindle with a weight that is off center.

13. The computer-implemented method of claim 10, wherein the generated bias is a directional bias.

14. A non-transitory computer readable medium including instructions that, when executed by at least one hardware processor of a computing system, cause the computing system to perform a method comprising:

generating movement of a camera sensor of a camera by a vibrating source located in the camera to generate a bias for the camera sensor;

measuring movement of the camera sensor by a high frequency accelerometer; and

capturing a plurality of images of a scene using the camera sensor based on the generated bias at a resolution supported by the camera sensor, wherein the vibrating source and the high frequency accelerometer are coupled to the camera sensor, wherein the high frequency accelerometer measures movement of the camera generated by the vibrating source sensor during the capture of the plurality of images.

15. The non-transitory computer readable medium of claim 14, wherein the camera sensor includes one or more of:

a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor.

16. The non-transitory computer readable medium of claim 14, wherein the vibrating source is a spindle with a weight that is off center.

17. The non-transitory computer readable medium of claim 14, wherein the generated bias is a directional bias.