Vehicular vision system using smart eye glasses

• US 10,671,868 B2
• Filed: 10/02/2018
• Issued: 06/02/2020
• Est. Priority Date: 10/02/2017
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Koravadi, Krishna
• Primary Examiner(s): La, Anh V
• Application Number:
  US16/149,370
• Publication Number:
  US 20190102636A1
• Time in Patent Office: 609 Days
• Field of Search: 340576, 3405731, 340937, 345156
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0181 Adaptation to the pilot/driver
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: H04W 12/33 using wearable devices, e.g. using a smartwatch or smart-glasses
• CPC Class Codes: H04W 4/48 for in-vehicle communication
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 4/90 Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]

Abstract

A vision system for a vehicle includes a control and smart eye glasses worn by a driver of the vehicle. The smart eye glasses include a driver monitoring camera that has a field of view that encompasses at least one eye of the driver when wearing the smart eye glasses. The control includes an image processor that processes image data captured by the driver monitoring camera to determine drowsiness of the driver. Responsive to determination that the driver is drowsy, the control communicates a signal to a portable device in the vehicle and the portable device in the vehicle generates an alert to the driver.

Claims

1. A vision system for a vehicle, said vision system comprising:

at least one vehicle-based camera disposed at a vehicle and having a field of view exterior of the vehicle;

a vehicle-based image processor disposed at the vehicle for processing image data captured by said at least one camera;

smart eye glasses worn by a driver of the vehicle, said smart eye glasses comprising a driver monitoring camera that has a field of view that encompasses at least one eye of the driver when wearing said smart eye glasses;

wherein said smart eye glasses comprise a heads up display control module that is operable to display information for viewing by the driver when the driver is wearing the smart eye glasses and driving the vehicle;

a control comprising an image processor that processes image data captured by said driver monitoring camera to determine drowsiness of the driver;

wherein, responsive to determination that the driver is drowsy while the driver is driving the vehicle, said control wirelessly communicates a signal to a portable device in the vehicle and the device in the vehicle generates an alert to the driver; and

wherein, responsive to determination that the driver is viewing toward a body structure of the vehicle, said heads up display control module displays images derived from image data captured by said at least one vehicle-based camera to display part of the exterior scene at said smart eye glasses such that the driver effectively views through the body structure of the vehicle.

2. The vision system of claim 1, wherein said control is part of said smart eye glasses.

3. The vision system of claim 1, wherein the portable device in the vehicle comprises the driver'"'"'s smart phone.

4. The vision system of claim 1, wherein said smart eye glasses include a gyro sensor, and wherein said control determines drowsiness of the driver at least in part responsive to an output of said gyro sensor.

5. The vision system of claim 1, wherein the information displayed for viewing by the driver when the driver is wearing the smart eye glasses and driving the vehicle comprises vehicle information received at said heads up display control module of said smart glasses from an electronic control unit of the vehicle.

6. The vision system of claim 5, wherein said at least one vehicle-based camera comprises a plurality of vehicle-based cameras having respective fields of view exterior of the vehicle.

7. The vision system of claim 6, wherein the displayed images derived from image data captured by said at least one vehicle-based camera comprise images overlayed over the driver'"'"'s view through said smart eye glasses.

8. The vision system of claim 6, wherein said heads up display control module projects images and information for viewing by the driver when the driver is wearing said smart eye glasses.

9. The vision system of claim 8, wherein the information includes vehicle status information.

10. A vision system for a vehicle, said vision system comprising:

at least one vehicle-based camera disposed at a vehicle and having a field of view exterior of the vehicle;

a vehicle-based image processor disposed at the vehicle for processing image data captured by said at least one camera;

smart eye glasses worn by a driver of the vehicle, said smart eye glasses comprising a driver monitoring camera that has a field of view that encompasses at least one eye of the driver when wearing said smart eye glasses;

wherein said smart eye glasses comprise a heads up display control module that is operable to display information for viewing by the driver when the driver is wearing the smart eye glasses and driving the vehicle;

wherein said smart eye glasses comprises a control comprising an image processor that processes image data captured by said driver monitoring camera to determine drowsiness of the driver;

wherein, responsive to determination that the driver is drowsy while the driver is driving the vehicle, said control communicates a signal to a portable device in the vehicle and the device in the vehicle generates an alert to the driver;

wherein the portable device in the vehicle comprises the driver'"'"'s smart phone; and

wherein, responsive to determination that the driver is viewing toward a body structure of the vehicle, said heads up display control module displays images derived from image data captured by said at least one vehicle-based camera to display part of the exterior scene at said smart eye glasses such that the driver effectively views through the body structure of the vehicle.

11. The vision system of claim 10, wherein said smart eye glasses include a gyro sensor, and wherein said control determines drowsiness of the driver at least in part responsive to an output of said gyro sensor.

12. The vision system of claim 10, wherein the information displayed for viewing by the driver when the driver is wearing the smart eye glasses and driving the vehicle comprises vehicle information received at said heads up display control module of said smart glasses from an electronic control unit of the vehicle.

13. The vision system of claim 12, wherein said at least one vehicle-based camera comprises a plurality of vehicle-based cameras having respective fields of view exterior of the vehicle.

14. The vision system of claim 13, wherein the displayed images derived from image data captured by said at least one vehicle-based camera comprise images overlayed over the driver'"'"'s view through said smart eye glasses.

15. The vision system of claim 13, wherein said heads up display control module projects images and information for viewing by the driver when the driver is wearing said smart eye glasses.

16. The vision system of claim 15, wherein the information includes vehicle status information.

17. A vision system for a vehicle, said vision system comprising:

smart eye glasses worn by a driver of the vehicle, said smart eye glasses comprising a driver monitoring camera that has a field of view that encompasses at least one eye of the driver when wearing said smart eye glasses;

a control comprising an image processor that processes image data captured by said driver monitoring camera to determine drowsiness of the driver;

at least one vehicle-based camera disposed at a vehicle and having a field of view exterior of the vehicle, wherein the image processor processes image data captured by said at least one vehicle-based camera;

wherein, responsive to determination that the driver is drowsy while the driver is driving the vehicle, said control communicates a signal to a portable device in the vehicle and the device in the vehicle generates an alert to the driver;

wherein, responsive to determination that the driver is viewing toward a structure of the vehicle, said smart eye glasses display images derived from image data captured by the at least one vehicle-based camera to display part of the exterior scene at said smart eye glasses such that the driver effectively views through the structure of the vehicle;

wherein said smart eye glasses display vehicle status information for viewing by the driver when the driver is wearing said smart eye glasses and driving the vehicle; and

wherein the information displayed for viewing by the driver when the driver is wearing the smart eye glasses and driving the vehicle comprises vehicle information received at said smart glasses from an electronic control unit of the vehicle.

18. The vision system of claim 17, wherein said control is part of said smart eye glasses.

19. The vision system of claim 17, wherein the portable device in the vehicle comprises the driver'"'"'s smart phone.

20. The vision system of claim 17, wherein said smart eye glasses include a gyro sensor, and wherein said control determines drowsiness of the driver at least in part responsive to an output of said gyro sensor.