System and method for determining eye closure state

• US 7,253,739 B2
• Filed: 03/10/2005
• Issued: 08/07/2007
• Est. Priority Date: 03/10/2005
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Delphi Technologies, Inc. (BorgWarner Incorporated)
• Inventors: Hammoud, Riad I., Malawey, Phillip V.
• Primary Examiner(s): NGUYEN, TAI T
• Application Number:
  US11/077,042
• Publication Number:
  US 20060204042A1
• Time in Patent Office: 880 Days
• Field of Search: 340/575, 340/576, 340/573.1, 382/107, 382/117, 382/278, 382/296, 382/103, 382/104, 348/77, 348/78
• US Class Current: 340/575
• CPC Class Codes: A61B 2503/22 Motor vehicles operators, e.g. drivers, pilots, captains
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 5/1103 Detecting eye twinkling
• CPC Class Codes: A61B 5/6821 Eye
• CPC Class Codes: A61B 5/6893 Cars
• CPC Class Codes: G06V 10/48 by mapping characteristic values of the pattern into a parameter space, e.g. Hough transformation
• CPC Class Codes: G06V 20/59 inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms

Abstract

A system and method are provided for monitoring an eye to determine eye closure. The system includes a video imaging camera oriented to generate images of an eye. The system also includes a video processor for processing the images generated with the video imaging camera. The processor includes an edge detector for detecting edges of the eye in the image and a line selector for generating substantially horizontal first and second lines representative of the detected edges. The processor determines the state of eye closure, such as eye open or eye closed, based on distance between the first and second lines. The system may be employed on a vehicle to determine the eye closure of a driver of the vehicle.

Claims

1. A system for monitoring an eye and determining eye closure, said system comprising:

a video imaging camera oriented to generate images of an eye; and

a video processor for processing the images generated with the video imaging camera, said video processor comprising an edge detector for detecting edges of the eye in the image and a line selector for generating at least first and second lines representative of the detected edges, and said processor determining a state of eye closure based on distance between the first and second lines, wherein said video processor compares the distance between the first and second lines to a threshold distance to determine if the eye is closed.

2. The system as defined in claim 1, wherein said first and second lines are substantially linear.

3. The system as defined in claim 2, wherein said first and second lines are substantially parallel to each other.

4. The system as defined in claim 3, wherein the first and second lines are substantially horizontal.

5. The system as defined in claim 1, wherein said processor dynamically determines the threshold distance when the eye is closed.

6. The system as defined in claim 1, wherein said processor performs a Hough Transformation to transform the at least first and second lines from Cartesian coordinates to polar coordinates and generates substantially parallel lines as the first and second lines.

7. The system as defined in claim 1, wherein said detected edges comprise a gray-scale representation of pixels imaging the eye.

8. The system as defined in claim 1, wherein the system is employed in a vehicle for monitoring an eye of a driver of the vehicle.

10. The system as defined in claim 1, wherein said first and second lines are substantially linear and substantially parallel to each other.

11. The system as defined in claim 10, wherein said first and second lines are substantially horizontal.

9. A vehicle eye monitoring system for monitoring an eye of a-person in a vehicle and determining eye closure, said system comprising:

a video imaging camera located on a vehicle and oriented to generate images of an eye of a person in the vehicle; and

a processor for processing the images generated with the video imaging camera, said video processor comprising an edge detector for detecting edges of the eye in the image and a line selector for generating first and second lines representative of the detected edges, said processor determining a state of eye closure based on distance between the first and second lines, wherein said processor compares the distance between the first and second lines to a threshold distance to determine if the eye is closed.

12. The system as defined in claim 9, wherein said processor dynamically determines the threshold distance when the eye is closed.

13. The system as defined in claim 9, wherein said line selector comprises a Hough Transformation for transforming the at least first and second lines from Cartesian coordinates to polar coordinates and generates substantially parallel lines as the first and second lines.

14. A method of monitoring an eye and determining eye closure, said method comprising the steps of:

arranging a video imaging camera to generate images of an eye;

generating an image of the eye;

processing the image to identify edges of the eye in the image;

generating at least first and second lines representative of the edges; and

determining an eye closure state based on distance between the first and second lines, wherein said step of determining an eve closure state comprises comparing the distance between the first and second lines to a threshold distance to determine if the eye is closed.

15. The method as defined in claim 14, wherein the step of generating at least first and second lines comprises generating first and second lines that are substantially linear and substantially parallel to each other.

16. The method as defined in claim 15, wherein the step of generating at least first and second lines comprises generating first and second lines that are substantially horizontal.

17. The method as defined in claim 14 further comprising the step of dynamically determining the threshold distance when the eye is closed.

18. The method as defined in claim 14, wherein the step of generating at least first and second lines comprises transforming first and second lines from Cartesian coordinates to polar coordinates with a Hough Transformation to generate substantially parallel lines as the first and second lines.

19. The method as defined in claim 14, wherein said step of arranging a video camera comprises arranging the video camera in a vehicle to monitor the eye of the driver of the vehicle.