Asymmetric Sensor Array for Capturing Images

• US 20150022643A1
• Filed: 07/18/2014
• Published: 01/22/2015
• Est. Priority Date: 07/19/2013
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Stetson, Philip Sean, Neifeld, Mark A., Musatenko, Yuriy
• Application Number:
  US14/335,841
• Publication Number:
  US 20150022643A1
• Time in Patent Office: Days
• US Class Current: 348/48
• CPC Class Codes: H01L 27/14627 Microlenses
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 23/13 with multiple sensors
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 25/702 SSIS architectures characterised by non-identical, non-equidistant or non-planar pixel layout
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

This document describes techniques and apparatuses for implementing an asymmetric sensor array for capturing images. These techniques and apparatuses enable better resolution, depth of color, or low-light sensitivity than many conventional sensor arrays.

Claims

1. An asymmetric sensor array comprising:

a main sensor having a main resolution and angled at a main angle; and

multiple peripheral sensors having peripheral resolutions, the peripheral resolutions asymmetric to the main resolution, at least one of the multiple peripheral sensors positioned at a peripheral angle different from the main angle of the main sensor.

2. The asymmetric sensor array as recited in claim 1, wherein the main resolution is a first number of pixels and the peripheral resolutions are each a second number of pixels, the first number of pixels being larger than the second number of pixels.

3. The asymmetric sensor array as recited in claim 1, wherein the main sensor includes a first size of pixels and the peripheral sensors include a second size of pixels, the first size smaller than the second size.

4. The asymmetric sensor array as recited in claim 1, wherein the peripheral angle of the at least one of the multiple peripheral sensors enables a depth of image to be created for an image of a scene based on peripheral data sensed by the one of the peripheral sensors of the scene and main data sensed by the main sensor of the same scene.

5. The asymmetric sensor array as recited in claim 1, wherein the main sensor is a monochrome with a clear color filter.

6. The asymmetric sensor array as recited in claim 1, wherein the main sensor includes a filter permitting infrared radiation to be sensed by the main sensor.

7. The asymmetric sensor array as recited in claim 1, wherein the main sensor is centered between the peripheral sensors.

8. The asymmetric sensor array as recited in claim 7, wherein the peripheral sensors include two or four peripheral sensors.

9. The asymmetric sensor array as recited in claim 1, wherein the peripheral sensors are Bayer sensors.

10. An imaging device comprising:

an imager, the imager comprising;

an asymmetric sensor array having a main sensor and two or more peripheral sensors; and

a lens stack for each of the main and peripheral sensors;

one or more computer processors; and

one or more computer-readable storage media having instructions stored thereon that, responsive to execution by the one or more computer processors, implements an image manager capable of performing operations comprising;

receiving, from the main sensor, sensor data, the sensor data including a high-resolution, monochromatic image of a scene;

receiving, from the peripheral sensors, peripheral sensor data, the peripheral sensor data including multiple low-resolution color images of the scene, at least one of the multiple low-resolution color images being sensed at an angle different than an angle of reception of the sensor data of the main sensor;

determining, based on at least one of the multiple low-resolution color images, a depth map; and

constructing a final image using the low-resolution color images, the depth map, and the monochromatic high-resolution image.

11. The imaging device of claim 10, wherein the final image includes a high-resolution of the high-resolution, monochromatic image and colors of the multiple low-resolution color images.

12. The imaging device of claim 10, wherein pixels of the peripheral sensors are larger than pixels of the main sensor.

13. The imaging device of claim 10, wherein the imaging device is capable of constructing, without a focusing mechanism, the final image in focus for objects of a scene that are beyond two meters from the imager.

14. The imaging device of claim 10, further comprising a near-far toggle focus system, the near-far toggle focus system effective to enable the image manager to construct the final image in focus, the focus on objects between one and two meters from the imager or beyond two meters from the imager.

15. An imager comprising:

a main sensor having a main lens stack, the main sensor having a main resolution and angled at a main angle; and

multiple peripheral sensors having respective peripheral lens stacks and peripheral resolutions, the peripheral resolutions asymmetric to the main resolution, at least one of the multiple peripheral sensors positioned at a peripheral angle different from the main angle of the main sensor.

16. The imager of claim 15, wherein the main sensor and the multiple peripheral sensors are within a single die or substrate.

17. The imager of claim 15, wherein the main lens stack includes an auto-focus device capable of determining a focus of the main sensor in part using depth data captured by the peripheral sensors.

18. The imager of claim 15, wherein the imager is capable of focusing, without an auto-focus mechanism, at objects in scenes beyond about two meters from the main lens.

19. The imager of claim 15, wherein the main sensor is a monochromatic sensor and the peripheral sensors are color sensors.

20. The imager of claim 19, wherein the main sensor has both a higher number and smaller size of pixels than each of the peripheral sensors.