Dense field imaging

• US 9,769,365 B1
• Filed: 02/14/2014
• Issued: 09/19/2017
• Est. Priority Date: 02/15/2013
• Status: Active Grant

• Current Assignee: Red.com, LLC
• Original Assignee: Red.com, LLC
• Inventors: Jannard, James H.
• Primary Examiner(s): CHEN, CHIA WEI A
• Application Number:
  US14/181,552
• Time in Patent Office: 1,313 Days
• Field of Search: 348 42- 60, 348373-376, 348340, 348 36
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 25/70 SSIS architectures; Circuits associated therewith

Abstract

Dense field imagers are disclosed which are configured to provide fused and/or stitched light field data for a scene. A dense field imager can include a plurality of imaging elements configured to be joined into image blocks or facets that each provides light field data about a scene. The dense field imager can include a plurality of facets in a fixed or modular fashion such that the dense field imager is configured to fuse and/or stitch light field data from the plurality of facets. The facets can be mounted such that one or more facets are non-coplanar with other facets. The facets can be configured to provide light field data with overlapping fields of view. Accordingly, the dense field imager can provide dense field data over a field of view covered by the plurality of facets.

Claims

1. An imaging array, comprising:

an array of imaging blocks, the array of imaging blocks comprising a first imaging block and a second imaging block, the first imaging block physically separate from and in electrical communication with a second imaging block, each respective imaging block of the first imaging block and the second image block comprising;

a support;

at least three imaging elements carried by the support, wherein each imaging element of the at least three imaging elements comprises a sensor comprising a plurality of pixels and a lens, and is positioned relative to the other imaging elements of the respective imaging block by the support;

a mechanical connector configured to connect the respective imaging block into the array of imaging blocks, wherein the respective imaging block is movable relative to the array of imaging blocks such that the orientation of the respective imaging block can be modified relative to one or more other imaging blocks of the array of imaging blocks without changing the relative position of the at least three imaging elements of the respective imaging block relative to one another; and

an electrical connector configured to electrically connect the respective imaging block into the array of imaging blocks; and

an image processing system configurable to;

using image data captured by the first imaging block, generate a first image data set representative of a first portion of a light field

using image data captured by second imaging block, generate a second image data set representative of a second portion of the light field; and

derive a third image data set from the first and second image data sets.

2. An imaging array as in claim 1, wherein at least the first imaging element comprises a monochromatic filter, wherein the sensor of the first imaging element detects substantially monochromatic light passing through the monochromatic filter.

3. An imaging array as in claim 1, wherein the support comprises a wafer substrate.

4. An imaging array as in claim 3, wherein the wafer substrate comprises a semiconductor material.

5. An imaging array as in claim 4, wherein the sensors are formed on the substrate.

6. An imaging array as in claim 3, wherein the lenses are wafer-level lenses.

7. An imaging array as in claim 1, further comprising an array support and a third imaging block, wherein the first, second, and third imaging blocks are carried by the array support.

8. An imaging array as in claim 1, wherein at least one of the sensors in the first imaging block is non-coplanar with at least one of the sensors in the second imaging block.

9. An imaging array as in claim 1, wherein each of the sensors in the first imaging block are coplanar, each of the sensors in the second imaging block are coplanar, and each of the sensors in the first imaging block are non-coplanar with each of the sensors in the second imaging block.

10. An imaging array as in claim 1, wherein each imaging element has a primary optical axis, and the primary optical axis of at least one of the imaging elements in the first imaging block is substantially non-parallel with the primary optical axis of at least one of the imaging elements in the second imaging block.

11. An imaging array as in claim 1, wherein each imaging element has a primary optical axis, the primary optical axes of the imaging elements in the first imaging block are substantially parallel, the primary optical axes of the imaging elements in the second imaging block are substantially parallel, and the primary optical axes of the imaging elements in the first imaging block are substantially non-parallel with the primary optical axes of the imaging elements in the second imaging block.

12. An imaging array as in claim 1, wherein a primary optical axis of at least one imaging element of the first imaging block is angularly adjustable with respect to a primary optical axis of at least one imaging element of the second imaging block.

13. An imaging array as in claim 12, wherein the imaging array comprises a user-actuatable control for achieving the angular adjustment.

14. An imaging array as in claim 1, further comprising an array support, wherein the array of imaging blocks and the image processing system are carried by the array support.

15. An imaging array as in claim 1, further comprising an array support, wherein the array of imaging blocks are carried by the array support and the image processing system is physically separate from the array support and receives the first and second image data sets wirelessly.

16. An imaging array as in claim 1, wherein the image processing system derives the third image data set at least partly by creating a spatial relationship tensor that includes spatial relationship information between elements of the first and second image data sets and using the spatial relationship tensor to derive the third image data set.

17. An imaging array as in claim 16, wherein the image processing system derives the third image data set at least partly by using the spatial relationship tensor to combine together the first and second portions of the light field.

18. An imaging array as in claim 1, wherein each respective imaging block further comprises one or more processors carried by the support and configured to generate a light field representation based on pixel data acquired from the sensors of the respective imaging block.

19. An imaging array as in claim 1, wherein one or more of the lenses are removably replaceable with lenses having different optical characteristics.

20. An imaging array as in claim 1, wherein the first imaging element comprises a fixed optical power and the second imaging element comprises a variable optical power.

21. An imaging array as in claim 1, wherein the first imaging element is configured to capture light of a first wavelength and the second imaging element is configured to capture light of a different wavelength.

22. An imaging array as in claim 1, wherein the sensor of the first imaging element comprises pixels of a first size and the sensor of the second imaging element comprises pixels of a second size.

23. An imaging array as in claim 1, wherein each respective imaging block comprises less than or equal to 500 imaging elements.

24. An imaging array as in claim 1, wherein each respective imaging block comprises at least 16 imaging elements.

25. An imaging array as in claim 1, wherein the imaging elements are arranged in at least one of a rectangular grid, a hexagonal grid, concentric circles, staggered, and random distribution.

26. An imaging array as in claim 1, wherein the imaging elements of each respective imaging block are arranged in a grid comprising at least four imaging elements by at least four imaging elements.

27. An imaging array as in claim 1, wherein the imaging elements are arranged in an array comprising at least eight rows of imaging elements and at least 24 columns of imaging elements.