Awareness detection system and method

• US 20090123031A1
• Filed: 11/13/2007
• Published: 05/14/2009
• Est. Priority Date: 11/13/2007
• Status: Abandoned Application

• Current Assignee: Delphi Technologies, Inc. (BorgWarner Incorporated)
• Original Assignee: Delphi Technologies, Inc. (BorgWarner Incorporated)
• Inventors: Hammoud, Riad I., Witt, Gerald J., Smith, Matthew R.
• Application Number:
  US11/983,879
• Publication Number:
  US 20090123031A1
• Time in Patent Office: Days
• US Class Current: 382/104
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/18 for vehicle drivers or machine operators
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G08B 21/06 indicating a condition of sleep, e.g. anti-dozing alarms
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

An awareness detection system and method that includes an imaging device positioned to obtain a plurality of images of at least a portion of a subject'"'"'s head, and an awareness processor in communication with the imaging device, wherein the awareness processor receives the plurality of images from the imaging device. The awareness processor performs the steps including classifying at least one image of the plurality of images based upon at least a portion of the subject'"'"'s head, monitoring movement of at least one eye of the subject if the at least one image is classified as a predetermined classification, and determining an awareness state of the subject based upon the monitored movement of the at least one eye.

Claims

1. An awareness detection system comprising:

an imaging device positioned to obtain a plurality of images of at least a portion of a subject'"'"'s head; and

an awareness processor in communication with said imaging device, wherein said awareness processor receives said plurality of images from said imaging device and performs the steps comprising;

classifying at least one image of said plurality of images based upon a head pose of at least a portion of said subject'"'"'s head with respect to at least one image of said plurality of images;

monitoring movement of at least one eye of said subject if said at least one image is classified as a predetermined classification; and

determining an awareness state of said subject based upon said monitored movement of at least one said eye, wherein said movement of said at least one eye is monitored over at least two images of said plurality of images obtained by said imagine device.

2. The awareness detection system of claim 1, wherein said classification of said image comprises one of frontal and non-frontal.

3. The awareness detection system of claim 2, wherein said predetermined classification is said frontal classification, such that at least one of said eyes is monitored after said subject in at least one said image is classified as said frontal classification.

4. The awareness detection system of claim 1, wherein said head pose classification comprises extracting at least one facial feature of said subject from said image, and comparing said at least one extracted facial feature to a head pose model.

5. The awareness detection system of claim 1, wherein said head pose classification comprises detecting at least a portion of a face of said subject, and classifying said detected face by a predetermined classification rule.

6. The awareness detection system of claim 1, wherein said determined awareness state is one of distracted and non-distracted.

7. The awareness detection system of claim 1, wherein said monitoring movement of at least one eye comprises comparing detected eye movement to a first threshold value.

8. The awareness detection system of claim 7, wherein said monitoring movement of at least one eye further comprises comparing a value of a counter to a second threshold value.

9. The awareness detection system of claim 1, wherein said awareness detection system is used with a vehicle to detect said subject in said vehicle.

10. A method of detecting awareness of a subject, said method comprising the steps of:

obtaining a plurality of images of at least a portion of a subject;

classifying at least one image of said plurality of images based upon a head pose of at least a portion of said subject'"'"'s head with respect to at least one image of said plurality of images, wherein said classification of said at least one image comprises one of frontal and non-frontal;

monitoring movement of at least one eye of said subject if said at least one image is classified as a predetermined classification; and

determining an awareness state of said subject based upon said monitored movement of at least one said eye, such that said awareness state comprises one of distracted and non-distracted, wherein said movement of said at least one eye is monitored over at least two images of said plurality of images.

11. The method of claim 10, wherein said predetermined classification for said monitoring movement step to be performed is said frontal classification, such that at least one of said eyes is monitored after said subject in at least one said image is classified as said frontal classification.

12. The method of claim 10, wherein said head pose classification comprises extracting at least one facial feature of said subject from said image, and comparing said at least one extracted facial feature to a head pose model.

13. The method of claim 10, wherein said head pose classification comprises detecting at least a portion of a face of said subject, and classifying said detected face by a predetermined classification rule.

14. The method of claim 10, wherein said step of monitoring movement of at least one eye comprises comparing detected eye movement to a first threshold value, such that it is determined that said subject is in a first awareness state when said counter value is greater than said first threshold value.

15. The method of claim 14, wherein said step of monitoring movement of at least one eye further comprises comparing a value of a counter to a second threshold value, such that it is determined that said subject is in said first awareness state when said counter value is less than said second threshold value, and that said subject is in a second awareness state when said counter value is greater than said second threshold value.

16. The method of claim 10, wherein said method is used with a vehicle to detect an awareness of said subject in said vehicle.

17. A method of detecting awareness of a subject, said method comprising the steps of:

obtaining a plurality of images of at least a portion of a subject, wherein said subject is an occupant in a vehicle;

classifying at least one image of said plurality of images based upon a head pose of at least a portion of said subject'"'"'s head with respect to at least one image of said plurality of images, wherein said subject in said at least one image is classified as one of frontal and non-frontal;

monitoring movement of at least one eye of said subject if said at least one image is classified as said frontal classification; and

determining an awareness state of said subject based upon said monitored movement of at least one said eye, such that said awareness state is one of distracted and non-distracted, wherein said movement of said at least one eye is monitored over at least two images of said plurality of images.

18. The method of claim 17, wherein said classification step comprises extracting at least one region of interest from said at least one image and classifying said region of interest.

19. The method of claim 17, wherein said step of monitoring movement of at least one eye comprises comparing detected eye movement to a first threshold value, such that it is determined that said subject is in a first awareness state when said counter value is greater than said second threshold value, and that said subject is in a second awareness state when said counter value is less than said second threshold value.

20. The method of claim 19, wherein said step of monitoring movement of at least one eye further comprises comparing a value of a counter to a second threshold value, such that it is determined that said subject is in a first awareness state when said counter value is greater than said second threshold value, and that said subject is in a second awareness state when said counter value is less than said second threshold value.