Sub-Pixel Array Optical Sensor

• US 20090290043A1
• Filed: 05/22/2008
• Published: 11/26/2009
• Est. Priority Date: 05/22/2008
• Status: Active Grant

• Current Assignee: Dynamax Imaging, LLC
• Original Assignee: Panavision Imaging LLC
• Inventors: LIU, Li, Poonnen, Thomas, Joyner, Michael Eugene, Karia, Ketan Vrajlal, Zarnowski, Jeffrey Jon
• Granted Patent: US 8,035,711 B2
• Time in Patent Office: Days
• US Class Current: 348/223.1
• CPC Class Codes: H04N 23/12 with one sensor only
• CPC Class Codes: H04N 23/843 Demosaicing, e.g. interpolating colour pixel values
• CPC Class Codes: H04N 25/134 based on three different wavelength filter elements

Abstract

Improving the dynamic range of captured images is disclosed by using sub-pixel arrays to capture light at different exposures and generate color pixel outputs for an image in a single frame. Each sub-pixel array can include multiple sub-pixels. The sub-pixels that make up a sub-pixel array can include red (R) sub-pixels, green (G) sub-pixels, blue (B) sub-pixels, and in some embodiments, clear sub-pixels. Those sub-pixel arrays having clear sub-pixels effectively have a higher exposure level and can capture low-light scenes (for dark areas) better than those sub-pixel arrays without clear sub-pixels. Each sub-pixel array can produce a color pixel output that is a combination of the outputs of the sub-pixels in the sub-pixel array. Each sub-pixel in a sub-pixel array can have the same exposure time, or in some embodiments, individual sub-pixels within a sub-pixel array can have different exposure times to improve the overall dynamic range even more.

Claims

1. A sub-pixel array for generating a single color pixel output as a component of an image, comprising:

a plurality of sub-pixels of a first color arranged in a first strip;

a plurality of sub-pixels of a second color arranged in a second strip; and

a plurality of sub-pixels of a third color arranged in third strip;

wherein the first, second and third strips are aligned with and adjacent to each other to form the sub-pixel array; and

wherein each of the sub-pixels are configured for generating a sub-pixel output that can be combined with other sub-pixel outputs within a single frame to generate the single color pixel output.

2. The sub-pixel array of claim 1, wherein the first color sub-pixels are red (R), the second color sub-pixels are green (G), and the third color sub-pixels are blue (B).

3. The sub-pixel array of claim 1, further comprising one or more clear (C) sub-pixels in one or more of the first, second, and third strips, the one or more clear sub-pixel configured for detecting lower light levels than the first, second or third color sub-pixels and enhancing a dynamic range of the sub-pixel array.

4. The sub-pixel array of claim 1, wherein the sub-pixel array is arranged in a diagonal orientation for improving visual resolution.

5. The sub-pixel array of claim 1, wherein one or more of the sub-pixels in the sub-pixel array are configurable for having a different exposure time than the other sub-pixels in the array.

6. The sub-pixel array of claim 1, the sub-pixel array integrally formed as part of an image sensor.

7. The sub-pixel array of claim 6, the image sensor forming a part of an image capture device.

8. The sub-pixel array of claim 1, wherein the plurality of sub-pixels of the first, second or third colors comprise colors of different shades.

9. An image sensor for generating a plurality of color pixel outputs as components of an image, comprising:

a plurality of sub-pixel arrays, each sub-pixel array configured for generating a different color pixel output, each sub-pixel array having

a plurality of sub-pixels of a first color arranged in a first strip,

a plurality of sub-pixels of a second color arranged in a second strip, and

a plurality of sub-pixels of a third color arranged in a third strip,

wherein the first, second and third strips are aligned with and adjacent to each other to form the sub-pixel array, and

wherein each of the sub-pixels are configured for generating a sub-pixel output that can be combined with other sub-pixel outputs within a single frame to generate the color pixel output.

10. The image sensor of claim 9, wherein within each sub-pixel array, the first color sub-pixels are red (R), the second color sub-pixels are green (G), and the third color sub-pixels are blue (B).

11. The image sensor of claim 9, one or more sub-pixel arrays further comprising one or more clear sub-pixels in one or more of the first, second, and third strips, the one or more clear sub-pixels configured for detecting lower light levels than the first, second or third color sub-pixels and enhancing a dynamic range of the sub-pixel array.

12. The image sensor of claim 11, wherein the plurality of sub-pixel arrays include a plurality of sub-pixel array designs, each sub-pixel array design having the clear sub-pixel in a different location in the sub-pixel array.

13. The image sensor of claim 12, wherein the plurality of sub-pixel array designs are arranged within the image sensor to produce a pseudo-random distribution of clear sub-pixels and reduce Moire patterns.

14. The image sensor of claim 9, wherein each sub-pixel array is arranged in a diagonal orientation for improving visual resolution.

15. The image sensor of claim 9, wherein one or more sub-pixels in one or more sub-pixel arrays are configurable for having a different exposure time than the other sub-pixels in the array.

16. The image sensor of claim 9, the image sensor forming a part of an image capture device.

17. The sub-pixel array of claim 9, wherein the plurality of sub-pixels of the first, second or third colors comprise colors of different shades.

18. An image capture device for generating an image, comprising:

an image sensor for generating a plurality of color pixel outputs as components of an image, the image sensor including a plurality of sub-pixel arrays, each sub-pixel array configured for generating a different color pixel output, each sub-pixel array having

a plurality of sub-pixels of a first color arranged in a first strip,

a plurality of sub-pixels of a second color arranged in a second strip, and

a plurality of sub-pixels of a third color arranged in a third strip,

wherein the first, second and third strips are aligned with and adjacent to each other to form the sub-pixel array, and

wherein each of the sub-pixels are configured for generating a sub-pixel output that can be combined with other sub-pixel outputs within a single frame to generate the color pixel output.

19. The image capture device of claim 18, further comprising an image processor coupled to the image sensor, the image processor programmed for interpolating the color pixel outputs and generating other color pixel values to satisfy display requirements of an orthogonal pixel arrangement.

20. The image capture device of claim 18, wherein within each sub-pixel array in the image sensor, the first color sub-pixels are red (R), the second color sub-pixels are green (G), and the third color sub-pixels are blue (B).

21. The image capture device of claim 18, one or more sub-pixel arrays within the image sensor further comprising one or more clear (C) sub-pixels in one or more of the first, second, and third strips, the one or more clear sub-pixels configured for detecting lower light levels than the first, second or third color sub-pixels and enhancing a dynamic range of the sub-pixel array.

22. The image capture device of claim 18, wherein the image sensor includes a plurality of sub-pixel array designs, each sub-pixel array design having the clear sub-pixel in a different location in the sub-pixel array.

23. The image capture device of claim 22, wherein the plurality of sub-pixel array designs are arranged within the image sensor to produce a pseudo-random distribution of clear sub-pixels and reduce Moire patterns.

24. The image capture device of claim 18, wherein each sub-pixel array in the image sensor is arranged in a diagonal orientation for improving visual resolution.

25. The image capture device of claim 18, wherein one or more sub-pixels in one or more sub-pixel arrays of the image sensor are configurable for having a different exposure time than the other sub-pixels in the array.

26. The image capture device of claim 18, wherein the plurality of sub-pixels of the first, second or third colors comprise colors of different shades.

27. A method for generating a single color pixel output as a component of an image, comprising:

arranging a plurality of sub-pixels of a first color in a first strip;

arranging a plurality of sub-pixels of a second color in a second strip;

arranging a plurality of sub-pixels of a third color in a third strip;

forming a sub-pixel array by aligning the first, second and third strips and placing them adjacent to each other;

obtaining a sub-pixel output from each sub-pixel; and

combining the sub-pixel outputs from each sub-pixel within a single frame to generate the single color pixel output.

28. The method of claim 27, wherein the first color sub-pixels are red (R), the second color sub-pixels are green (G), and the third color sub-pixels are blue (B).

29. The method of claim 27, further comprising forming one or more clear (C) sub-pixels in one or more of the first, second, and third strips, the one or more clear sub-pixels configured for detecting lower light levels than the first, second or third color sub-pixels and enhancing a dynamic range of the sub-pixel array.

30. The method of claim 27, further comprising arranging the sub-pixel array in a diagonal orientation for improving visual resolution.

31. The method of claim 27, further comprising providing a different exposure time to one or more of the sub-pixels in the sub-pixel array as compared to the other sub-pixels in the array.

32. The method of claim 27, wherein the plurality of sub-pixels of the first, second or third colors comprise colors of different shades.

33. A method for generating a plurality of color pixel outputs as components of an image, comprising:

forming a plurality of sub-pixel arrays, each sub-pixel array configured for generating a different color pixel output, each sub-pixel array formed by

arranging a plurality of sub-pixels of a first color in a first strip,

arranging a plurality of sub-pixels of a second color in a second strip,

arranging a plurality of sub-pixels of a third color in a third strip, and

aligning the first, second and third strips adjacent to each other; and

generating the color pixel output from each sub-pixel array by

obtaining a sub-pixel output from each sub-pixel within the sub-pixel array, and

combining the sub-pixel outputs within a single frame to generate the color pixel output.

34. The method of claim 33, wherein within each sub-pixel array, the first color sub-pixels are red (R), the second color sub-pixels are green (G), and the third color sub-pixels are blue (B).

35. The method of claim 33, further comprising forming one or more clear (C) sub-pixels in one or more of the first, second, and third strips of one or more sub-pixel arrays, the one or more clear sub-pixels configured for detecting lower light levels than the first, second or third color sub-pixels and enhancing a dynamic range of the sub-pixel array.

36. The method of claim 35, further comprising utilizing a plurality of sub-pixel array designs to form the plurality of sub-pixel arrays, each sub-pixel array design having the clear sub-pixel in a different location in the sub-pixel array.

37. The method of claim 36, further comprising arranging the plurality of sub-pixel array designs to produce a pseudo-random distribution of clear sub-pixels and reduce Moire patterns.

38. The method of claim 33, further comprising arranging each sub-pixel array in a diagonal orientation for improving visual resolution.

39. The method of claim 33, further comprising providing one or more sub-pixels in one or more sub-pixel arrays with a different exposure time as compared to the other sub-pixels in the array.

40. The method of claim 33, further comprising interpolating the color pixel outputs and generating other color pixel values to satisfy display requirements of an orthogonal pixel arrangement.

41. The method of claim 33, wherein the plurality of sub-pixels of the first, second or third colors comprise colors of different shades.

42. A method for generating a color pixel output having an enhanced dynamic range, comprising:

forming an array of color sub-pixels and at least one clear sub-pixel;

obtaining a sub-pixel output from each sub-pixel; and

combining the sub-pixel outputs from each sub-pixel within a single frame to generate the color pixel output.