VEHICLE VISION SYSTEM WITH DRIVER MONITORING

• US 20150296135A1
• Filed: 04/01/2015
• Published: 10/15/2015
• Est. Priority Date: 04/10/2014
• Status: Abandoned Application

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Rachor, Martin, Wacquant, Sylvie
• Application Number:
  US14/675,929
• Publication Number:
  US 20150296135A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 10/48 by mapping characteristic values of the pattern into a parameter space, e.g. Hough transformation
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/167 using comparisons between temporally consecutive images
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body

Abstract

A vision system of a vehicle includes a pair of cameras and a control. The cameras are disposed in a vehicle and have a field of view encompassing a region where a head of a driver of the vehicle is located. The control includes an image processor operable to process image data captured by the cameras. The control, responsive to processing of captured image data by the image processor, is operable to determine a driver'"'"'s head and eyes and gaze direction. The control, responsive to processing by the image processor of image data captured by both cameras of the pair of cameras, is operable to determine a three dimensional eye position and a three dimensional gaze vector for at least one of the driver'"'"'s eyes.

Claims

1. A vision system of a vehicle, said vision system comprising:

a pair of cameras disposed in a vehicle equipped with said vision system and each having a field of view encompassing a region where a head of a driver who is normally operating the equipped vehicle is located;

a control having an image processor operable to process image data captured by said cameras;

wherein said control, responsive to processing of captured image data by said image processor, is operable to determine a driver'"'"'s head and eyes and gaze direction; and

wherein said control, responsive to processing by said image processor of image data captured by both cameras of said pair of cameras, is operable to determine a three dimensional eye position and a three dimensional gaze vector for at least one of the driver'"'"'s eyes.

2. The vision system of claim 1, wherein said control, responsive to processing of captured image data by said image processor, is operable to determine a three dimensional eye position and a three dimensional gaze vector for each of the driver'"'"'s eyes.

3. The vision system of claim 1, comprising an illumination source that emits illumination towards the region where the head of the driver who is normally operating the equipped vehicle is located.

4. The vision system of claim 3, wherein said illumination source comprises an infrared light emitting illumination source.

5. The vision system of claim 4, wherein the three dimensional gaze vector is determined by fitting an ellipse to an iris of a respective eye of the driver, wherein said ellipse is generated responsive to processing of captured image data.

6. The vision system of claim 1, wherein the three dimensional gaze vector is determined by fitting an ellipse to an iris of a respective eye of the driver, wherein said ellipse is generated responsive to processing of captured image data.

7. The vision system of claim 6, wherein said ellipse is determined by fitting a first parabola along an upper eye lid of the eye and a second parabola along a lower eye lid of the eye, wherein said first and second parabolas are generated responsive to processing of captured image data.

8. The vision system of claim 7, wherein said ellipse is framed by the first and second parabolas with the eye'"'"'s iris as the ellipse center.

9. The vision system of claim 7, wherein the first and second parabolas are determined via respective Hough transformations.

10. The vision system of claim 1, wherein said cameras are spaced apart in the vehicle and forward of the head of the driver.

11. The vision system of claim 10, wherein one of said cameras is disposed at a driver side A-pillar region of the equipped vehicle and another of said cameras is disposed at a center region of a dashboard of the equipped vehicle.

12. A vision system of a vehicle, said vision system comprising:

a pair of cameras disposed in a vehicle equipped with said vision system and each having a field of view encompassing a region where a head of a driver who is normally operating the equipped vehicle is located;

wherein said cameras are spaced apart in the vehicle and forward of the head of the driver and wherein said cameras are disposed at generally opposite sides of the head of the driver, and wherein one of said cameras is disposed at a driver side A-pillar region of the equipped vehicle and another of said cameras is disposed at a center region of a dashboard of the equipped vehicle;

a control having an image processor operable to process image data captured by said cameras;

wherein said control, responsive to processing of captured image data by said image processor, is operable to determine a driver'"'"'s head and eyes and gaze direction;

wherein said control, responsive to processing by said image processor of image data captured by both cameras of said pair of cameras, is operable to determine a three dimensional eye position and a three dimensional gaze vector for at least one of the driver'"'"'s eyes; and

wherein the three dimensional gaze vector is determined by fitting an ellipse to an iris of a respective eye of the driver, wherein said ellipse is generated responsive to processing of captured image data.

13. The vision system of claim 12, wherein said control, responsive to processing of captured image data by said image processor, is operable to determine a three dimensional eye position and a three dimensional gaze vector for each of the driver'"'"'s eyes.

14. The vision system of claim 13, wherein said control determines the three dimensional eye position and the three dimensional gaze vector for each eye by processing image data captured by both cameras of said pair of cameras.

15. The vision system of claim 12, comprising an illumination source that emits illumination towards the region where the head of the driver who is normally operating the equipped vehicle is located, and wherein said illumination source comprises an infrared light emitting illumination source.

16. The vision system of claim 12, wherein said ellipse is determined by fitting a first parabola along an upper eye lid of the eye and a second parabola along a lower eye lid of the eye, wherein said first and second parabolas are generated responsive to processing of captured image data.

17. A vision system of a vehicle, said vision system comprising:

a pair of cameras disposed in a vehicle equipped with said vision system and each having a field of view encompassing a region where a head of a driver who is normally operating the equipped vehicle is located;

wherein said cameras are spaced apart in the vehicle and forward of the head of the driver and wherein said cameras are disposed at generally opposite sides of the head of the driver;

an illumination source that emits illumination towards the region where the head of the driver who is normally operating the equipped vehicle is located;

a control having an image processor operable to process image data captured by said cameras;

wherein said control, responsive to processing of captured image data by said image processor, is operable to determine a driver'"'"'s head and eyes and gaze direction; and

wherein said control, responsive to processing by said image processor of image data captured by both cameras of said pair of cameras, is operable to determine a three dimensional eye position and a three dimensional gaze vector for each of the driver'"'"'s eyes.

18. The vision system of claim 17, wherein the three dimensional gaze vector is determined by fitting an ellipse to an iris of a respective eye of the driver, wherein said ellipse is generated responsive to processing of captured image data, and wherein said ellipse is determined by fitting a first parabola along an upper eye lid of the eye and a second parabola along a lower eye lid of the eye, wherein said first and second parabolas are generated responsive to processing of captured image data.

19. The vision system of claim 18, wherein said ellipse is framed by the first and second parabolas with the eye'"'"'s iris as the ellipse center.

20. The vision system of claim 17, wherein said illumination source comprises an infrared light emitting illumination source.