Display assembly incorporating an image sensor

• US 10,733,437 B2
• Filed: 03/12/2018
• Issued: 08/04/2020
• Est. Priority Date: 03/22/2017
• Status: Active Grant

• Current Assignee: Gentex Corporation
• Original Assignee: Gentex Corporation
• Inventors: Weller, Andrew D., Lee, Ethan J., VanderPloeg, John A.
• Primary Examiner(s): Huang, Frank F
• Application Number:
  US15/918,600
• Publication Number:
  US 20180276466A1
• Time in Patent Office: 876 Days
• CPC Class Codes: B60R 1/04 mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/103 using camera systems provided with artificial illumination device, e.g. IR light source
• CPC Class Codes: B60R 2300/8046 for replacing a rear-view mirror system
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G09G 3/3413 Details of control of colour illumination sources
• CPC Class Codes: H04N 23/10 for generating image signals from different wavelengths
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A vehicle display device is disclosed. The device comprises an image sensor comprising an imager configured to capture image data and a display. The display comprises a plurality of display elements forming a display surface. The display surface forms a display perimeter. The display elements surround the image sensor on the display surface such that the image sensor is disposed within the display perimeter.

Claims

1. A display apparatus for a vehicle comprising:

a display device comprising a plurality of display elements forming a display surface having a display perimeter disposed in a housing and configured to display image data in a display emission;

an electrochromic element abutting the display device and configured to selectively transmit the display emission therethrough; and

an imager module disposed on the display surface, the imager module comprising;

an image sensor configured to capture image data in a field of view directed through the electrochromic element; and

a light source configured to transmit an emission through the electrochromic element, wherein the image sensor is configured to capture image data comprising reflected light from the emission through the electrochromic element; and

wherein the display elements comprise a pixel array extending to the perimeter of the display and wherein a plurality of pixels of the pixel array form an opening on the display surface in which the imager module and the light source are located, and wherein the pixels of the pixel array surround the image sensor and the light source on the display surface.

2. The display apparatus according to claim 1, wherein the object corresponds to an eye of an occupant of the vehicle.

3. The display apparatus according to claim 1, wherein the light source is configured to emit light in a near-infrared (NIR) range.

4. The display apparatus according to claim 1, further comprising a controller in communication with the display and the imager module, wherein the controller is configured to:

process the image data;

identify the object in the image data; and

display the object on a portion of the display device.

5. The display apparatus according to claim 4, wherein the controller is further configured to:

communicate an authorization signal to a vehicle control module to control one or more vehicle functions based on the identification of the object.

6. The display apparatus according to claim 1, wherein the display apparatus is implemented as a rearview display device operable to display a rearward directed field of view from the vehicle.

7. The display apparatus according to claim 1, wherein the electrochromic element comprises:

a first substrate comprising a first surface and a second surface;

a second substrate comprising a third surface and a fourth surface, wherein the first substrate and the second substrate form a cavity; and

an electrochromic medium contained in the cavity.

8. The scanning display according to claim 7, wherein the image sensor is positioned adjacent to the fourth surface and the field of view is directed outward through the first surface.

18. The display apparatus according to claim 1, wherein a plurality of pixels of the pixel array form a contiguous display surface interrupted by the opening wherein the pixels are omitted.

9. A display apparatus for a vehicle comprising:

a display device comprising a plurality of display elements forming a display surface having a display perimeter disposed in a housing and configured to display image data in a display emission, wherein the plurality of display elements comprise a pixel array comprising a plurality of pixels arranged in rows and columns;

an electrochromic element abutting the display device and configured to selectively transmit the display emission therethrough; and

an image sensor configured to capture image data comprising an object in a field of view directed through the electrochromic element, wherein the display elements form an opening and surround the image sensor on the display surface such that the image sensor is disposed within the display perimeter, wherein the opening is formed by omitting at least one of the display elements in the pixel array.

10. The display apparatus according to claim 9, wherein the pixels comprise a plurality of red pixels, green pixels, and blue pixels arranged in sequence in the rows and columns.

11. The display apparatus according to claim 10, wherein the image sensor is positioned in an opening formed by omitting one or more of the red, green, or blue pixels from the display surface.

12. The display apparatus according to claim 11, wherein the image sensor is surrounded by at least one of the rows or columns of pixels on the display surface.

13. The display apparatus according to claim 9, wherein the pixel array forms a contiguous display region comprising a display perimeter.

14. The display apparatus according to claim 13, wherein a portion of the pixel array forms an opening in the contiguous display region, wherein the pixels are omitted from the opening.

15. The display apparatus according to claim 14, wherein the image sensor is positioned in the opening on the display surface and surrounded by the pixels of the pixel array on the display surface.

16. A vehicle display device comprising:

an image sensor comprising an imager configured to capture image data;

at least one light source in communication with the image sensor, wherein the image sensor and the at least one light source are disposed within a sensor perimeter formed on a display surface of the vehicle display device; and

a display comprising a plurality of display elements forming the display surface having a display perimeter, wherein the display elements form an opening containing the sensor perimeter and surround the sensor perimeter on the display surface such that the image sensor and the light source are disposed within the display perimeter, wherein the display elements form the opening in the display surface and the opening conforms to and surrounds the sensor perimeter.

17. The device according to claim 16, further comprising:

an electrochromic element comprising;

a first substrate comprising a first surface and a second surface;

a second substrate comprising a third surface and a fourth surface, wherein the first substrate and the second substrate form a cavity; and

an electrochromic medium contained in the cavity; and

wherein the image sensor is directed toward the fourth surface and configured to capture the image data of an object through the electrochromic element.