Image capture device, pixel, and method providing improved phase detection auto-focus performance

• US 10,440,301 B2
• Filed: 09/08/2017
• Issued: 10/08/2019
• Est. Priority Date: 09/08/2017
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Li, Xiangli, Patel, Manoj C.
• Primary Examiner(s): Jerabek, Kelly L
• Application Number:
  US15/699,806
• Publication Number:
  US 20190082130A1
• Time in Patent Office: 760 Days
• Field of Search: 348345, 348349
• CPC Class Codes: G02B 7/09 adapted for automatic focusing or varying magnification
• CPC Class Codes: G02B 7/36 using image sharpness techniques , e.g. image processing techniques for generating autofocus signals image data processing per se G06T; in cameras having a solid state image sensor H04N23/67
• CPC Class Codes: H01L 27/14621 Colour filter arrangements
• CPC Class Codes: H01L 27/14627 Microlenses
• CPC Class Codes: H01L 27/1463 Pixel isolation structures
• CPC Class Codes: H01L 27/14641 Electronic components shared by two or more pixel-elements, e.g. one amplifier shared by two pixel elements
• CPC Class Codes: H01L 27/14645 Colour imagers
• CPC Class Codes: H04N 2209/042 having a single pick-up sensor
• CPC Class Codes: H04N 23/10 for generating image signals from different wavelengths
• CPC Class Codes: H04N 23/12 with one sensor only
• CPC Class Codes: H04N 23/672 based on the phase difference signals
• CPC Class Codes: H04N 25/135 based on four or more different wavelength filter elements
• CPC Class Codes: H04N 25/702 SSIS architectures characterised by non-identical, non-equidistant or non-planar pixel layout
• CPC Class Codes: H04N 25/704 Pixels specially adapted for focusing, e.g. phase difference pixel sets
• CPC Class Codes: H04N 25/75 Circuitry for providing, modifying or processing image signals from the pixel array
• CPC Class Codes: H04N 25/778 comprising amplifiers shared between a plurality of pixels, i.e. at least one part of the amplifier must be on the sensor array itself

Abstract

An image capture device, pixel, and method of determining a focus setting for an image capture device are described. The image capture device includes an imaging area and a pixel readout circuit. The imaging area includes a plurality of pixels. The plurality of pixels includes multiple pixels in which each pixel of the multiple pixels includes a two-dimensional array of photodetectors and a microlens. Each photodetector in the array of photodetectors for a pixel is electrically isolated from each other photodetector in the array of photodetectors. A microlens is disposed over the array of photodetectors for the pixel. The pixel readout circuit includes, per pixel, a shared readout circuit associated with the array of photodetectors for the pixel and a set of charge transfer transistors. Each charge transfer transistor is operable to connect a photodetector in the array of photodetectors to the shared readout circuit.

Claims

1. An image capture device, comprising:

an imaging area comprising a plurality of color-filtered pixels arranged in Bayer pattern rows and Bayer pattern columns, wherein;

each color-filtered pixel comprises a two-dimensional array of photodetectors;

each photodetector in an array of photodetectors is electrically isolated from each other photodetector in the array of photodetectors; and

a different microlens is disposed over each array of photodetectors;

a pixel readout circuit comprising, for each color-filtered pixel;

a shared readout circuit associated with the array of photodetectors for the color-filtered pixel; and

a set of charge transfer transistors, each charge transfer transistor operable to connect a photodetector in the array of photodetectors to the shared readout circuit; and

a processor configured to;

operate the sets of charge transfer transistors for the color-filtered pixels in a first Bayer pattern row to detect a first phase difference in a first set of edges of an image; and

operate the sets of charge transfer transistors for the color-filtered pixels in a second Bayer pattern row to detect a second phase difference in a second set of edges of the image, the first set of edges orthogonal to the second set of edges.

2. The image capture device of claim 1 wherein each shared readout circuit comprises a floating diffusion node.

3. The image capture device of claim 2, wherein the processor is configured to operate a first set of charge transfer transistors for a first color-filtered pixel to simultaneously transfer charge from a pair of photodetectors of the first color-filtered pixel to a first floating diffusion node of the first color-filtered pixel, the pair of photodetectors selected from:

a first pair of photodetectors in a first row;

a second pair of photodetectors in a second row;

a third pair of photodetectors in a first column; and

a fourth pair of photodetectors in a second column.

4. The image capture device of claim 1, further comprising:

a lens, wherein the processor is configured to;

identify an out-of-focus condition from at least one of the first phase difference or the second phase difference; and

adjust a relationship between the plurality of color-filtered pixels and the lens.

5. The image capture device of claim 1, wherein each color-filtered pixel comprises a color filter disposed between the microlens and the array of photodetectors for the color-filtered pixel.

6. The image capture device of claim 1, wherein a peripheral portion of each microlens has a convex shape.

7. The image capture device of claim 1, wherein:

operating the sets of charge transfer transistors for the color-filtered pixels in the first Bayer pattern row to detect the first phase difference comprises configuring a first set of charge transfer transistors for a first pixel to sum charges of a first pair of photodetectors aligned along a first direction;

operating the sets of charge transfer transistors for the color-filtered pixels in the second Bayer pattern row to detect the second phase difference comprises configuring a second set of charge transfer transistors for a second pixel to sum charges of a second pair of photodetectors aligned along a second direction.

8. An image capture device, comprising:

an imaging area comprising a plurality of color-filtered pixels arranged in Bayer pattern rows and Bayer pattern columns, wherein;

each color-filtered pixel comprises a two-dimensional array of photodetectors;

each photodetector in an array of photodetectors is electrically isolated from each other photodetector in the array of photodetectors; and

a different microlens is disposed over each array of photodetectors;

a pixel readout circuit comprising, for each color-filtered pixel;

a shared readout circuit associated with the array of photodetectors for the color-filtered pixel; and

a set of charge transfer transistors, each charge transfer transistor operable to connect a photodetector in the array of photodetectors to the shared readout circuit; and

a processor configured to;

operate the sets of charge transfer transistors for the color-filtered pixels in a first Bayer pattern column to detect a first phase difference in a first set of edges of an image; and

operate the sets of charge transfer transistors for the color-filtered pixels in a second Bayer pattern column to detect a second phase difference in a second set of edges of the image, the first set of edges orthogonal to the second set of edges.

9. The image capture device of claim 8 wherein each shared readout circuit comprises a floating diffusion node.

10. The image capture device of claim 9, wherein the processor is configured to operate a first set of charge transfer transistors for a first color-filtered pixel to simultaneously transfer charge from a pair of photodetectors of the first color-filtered pixel to a first floating diffusion node of the first color-filtered pixel, the pair of photodetectors selected from:

a first pair of photodetectors in a first row;

a second pair of photodetectors in a second row;

a third pair of photodetectors in a first column; and

a fourth pair of photodetectors in a second column.

11. The image capture device of claim 8, further comprising:

a lens, wherein the processor is configured to;

identify an out-of-focus condition from at least one of the first phase difference or the second phase difference; and

adjust a relationship between the plurality of color-filtered pixels and the lens.

12. The image capture device of claim 8, wherein each color-filtered pixel comprises a color filter disposed between the microlens and the array of photodetectors for the color-filtered pixel.

13. The image capture device of claim 8, wherein a peripheral portion of each microlens has a convex shape.

14. The image capture device of claim 8, wherein:

operating the sets of charge transfer transistors for the color-filtered pixels in the first Bayer pattern column to detect the first phase difference comprises configuring a first set of charge transfer transistors for a first pixel to sum charges of a first pair of photodetectors aligned along a first direction;

operating the sets of charge transfer transistors for the color-filtered pixels in the second Bayer pattern column to detect the second phase difference comprises configuring a second set of charge transfer transistors for a second pixel to sum charges of a second pair of photodetectors aligned along a second direction.

15. An image capture device, comprising:

an imaging area comprising a plurality of color-filtered pixels arranged in Bayer pattern rows and Bayer pattern columns, wherein;

each color-filtered pixel comprises a two-dimensional array of photodetectors;

each photodetector in an array of photodetectors is electrically isolated from each other photodetector in the array of photodetectors; and

a different microlens is disposed over each array of photodetectors;

a pixel readout circuit comprising, for each color-filtered pixel;

a shared readout circuit associated with the array of photodetectors for the color-filtered pixel; and

a set of charge transfer transistors, each charge transfer transistor operable to connect a photodetector in the array of photodetectors to the shared readout circuit; and

a processor configured to;

operate the sets of charge transfer transistors for a first set of color-filtered pixels in a first Bayer pattern column to detect a first phase difference in a first set of edges of an image;

operate the sets of charge transfer transistors for a second set of color-filtered pixels in the first Bayer pattern column to detect a second phase difference in a second set of edges of the image, the first set of edges orthogonal to the second set of edges;

operate the sets of charge transfer transistors for a third set of color-filtered pixels in a second Bayer pattern column to detect the first phase difference in the first set of edges of the image; and

operate the sets of charge transfer transistors for a fourth set of color-filtered pixels in the second Bayer pattern column to detect the second phase difference in the second set of edges of the image.

16. The image capture device of claim 15 wherein each shared readout circuit comprises a floating diffusion node.

17. The image capture device of claim 16, wherein the processor is configured to operate a first set of charge transfer transistors for a first color-filtered pixel to simultaneously transfer charge from a pair of photodetectors of the first color-filtered pixel to a first floating diffusion node of the first color-filtered pixel, the pair of photodetectors selected from:

a first pair of photodetectors in a first row;

a second pair of photodetectors in a second row;

a third pair of photodetectors in a first column; and

a fourth pair of photodetectors in a second column.

18. The image capture device of claim 15, further comprising:

a lens, wherein the processor is configured to;

identify an out-of-focus condition from at least one of the first phase difference or the second phase difference; and

adjust a relationship between the plurality of color-filtered pixels and the lens.

19. The image capture device of claim 15, wherein each color-filtered pixel comprises a color filter disposed between the microlens and the array of photodetectors for the color-filtered pixel.

20. The image capture device of claim 15, wherein a peripheral portion of each microlens has a convex shape.