Capturing and processing of images captured by camera arrays including cameras dedicated to sampling luma and cameras dedicated to sampling chroma
First Claim
Patent Images
1. A camera array, comprising:
- a plurality of cameras configured to capture images of a scene, where each camera comprises;
optics comprising at least one lens element and at least one aperture; and
a sensor comprising a two dimensional array of pixels and control circuitry for controlling imaging parameters;
a controller configured to control operation parameters of the plurality of cameras; and
an image processing pipeline module;
wherein the plurality of cameras includes at least one camera dedicated to sampling luma and cameras dedicated to sampling chroma;
wherein the cameras that sample chroma are arranged symmetrically within the camera array to address occlusion due to parallax;
wherein the image processing pipeline module is configured to;
measure parallax using images captured by the plurality of cameras to produce a depth map; and
fuse images captured by the at least one camera dedicated to sampling luma and the cameras dedicated to sampling chroma to produce an image; and
wherein a camera dedicated to sampling luma forms a central camera and cameras dedicated to sampling chroma are distributed symmetrically around the central camera.
14 Assignments
0 Petitions
Accused Products
Abstract
A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.
483 Citations
29 Claims
-
1. A camera array, comprising:
-
a plurality of cameras configured to capture images of a scene, where each camera comprises; optics comprising at least one lens element and at least one aperture; and
a sensor comprising a two dimensional array of pixels and control circuitry for controlling imaging parameters;a controller configured to control operation parameters of the plurality of cameras; and an image processing pipeline module; wherein the plurality of cameras includes at least one camera dedicated to sampling luma and cameras dedicated to sampling chroma; wherein the cameras that sample chroma are arranged symmetrically within the camera array to address occlusion due to parallax; wherein the image processing pipeline module is configured to; measure parallax using images captured by the plurality of cameras to produce a depth map; and fuse images captured by the at least one camera dedicated to sampling luma and the cameras dedicated to sampling chroma to produce an image; and wherein a camera dedicated to sampling luma forms a central camera and cameras dedicated to sampling chroma are distributed symmetrically around the central camera. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27)
-
-
28. A camera array, comprising:
-
a monolithic integrated module forming a linear array of cameras, where the monolithic integrated module comprises; a lens element array forming the optics of each of the plurality of cameras, where the optics of each camera comprises at least one lens element and at least one aperture; and a single semiconductor substrate on which all of the pixels and control circuitry for each camera are formed; a controller configured to control operation parameters of the linear array of cameras; and an image processing pipeline module; wherein the linear array of cameras includes at least one camera dedicated to sampling luma and cameras dedicated to sampling chroma; wherein a camera dedicated to sampling luma forms a central camera and the cameras that sample chroma are arranged symmetrically within the linear array on either side of the central camera to address occlusion due to parallax; wherein the image processing pipeline module is configured to; measure parallax using images captured by the linear array of cameras to produce a depth map; and fuse images captured by the at least one camera dedicated to sampling luma and the cameras dedicated to sampling chroma to produce an image; and wherein the image processing pipeline module is configured to select at least one distance as an “
in best focus”
distance and blur the produced image based upon the depth map.
-
-
29. A camera array, comprising:
-
a plurality of cameras formed on separate semiconductor substrates and mounted to a motherboard, where each camera comprises; optics comprising at least one lens element and at least one aperture; and a sensor comprising a two dimensional array of pixels and control circuitry for controlling imaging parameters; a controller configured to control operation parameters of the linear array of cameras; and an image processing pipeline module; wherein the linear array of cameras includes at least one camera dedicated to sampling luma and cameras dedicated to sampling chroma; wherein a camera dedicated to sampling luma forms a central camera and the cameras that sample chroma are arranged symmetrically within the linear array on either side of the central camera to address occlusion due to parallax; wherein the image processing pipeline module is configured to; measure parallax using images captured by the linear array of cameras to produce a depth map; and fuse images captured by the at least one camera dedicated to sampling luma and the cameras dedicated to sampling chroma to produce an image; and wherein the image processing pipeline module is configured to select at least one distance as an “
in best focus”
distance and blur the produced image based upon the depth map.
-
Specification