Systems and methods for determining eye glances

• US 20020176604A1
• Filed: 04/16/2001
• Published: 11/28/2002
• Est. Priority Date: 04/16/2001
• Status: Abandoned Application

• Current Assignee: ImageCorp, Inc. (Leidos Holdings, Inc.)
• Original Assignee: ImageCorp, Inc. (Leidos Holdings, Inc.)
• Inventors: Zheng, Qinfen, Shekhar, Chandra, Chellappa, Rama, Burlina, Philippe
• Application Number:
  US09/836,079
• Publication Number:
  US 20020176604A1
• Time in Patent Office: Days
• US Class Current: 382/104
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments

Abstract

A method determines driver glance information from an input video by performing motion analysis on the video; and performing image analysis on a frame of the video.

Claims

1. A method to process driver glance information from an input video, comprising:

performing motion analysis on the video; and

performing image analysis on a frame of the video.

2. The method of claim 1, further comprising performing temporal analysis.

3. The method of claim 2, further comprising determining the driver glance direction using time-history of motion measurements.

4. The method of claim 2, further comprising segmenting the input video into one or more key frames.

5. The method of claim 1, wherein the motion analysis uses optic flow computation.

6. The method of claim 1, wherein the motion analysis uses feature point tracking.

7. The method of claim 1, wherein the single-frame image analysis uses color and intensity information in the image.

8. The method of claim 1, wherein the single-frame image analysis localizes and characterizes the driver'"'"'s face.

9. The method of claim 1, further comprising gathering statistics of driver gazing activity.

10. The method of claim 9, wherein each driver gazing activity is summarized with a begin frame, an end frame, nature of the glance, duration of the glance and direction of the glance.

11. The method of claim 1, wherein the motion analysis detects head motion measurement from the video.

12. The method of claim 1, further comprising performing glance recognition from the video

13. The method of claim 12, further comprising detecting qualitative head movements and eye glances.

14. The method of claim 13, wherein the head movements include “

looking left”

, “

looking right”

, “

looking up”

, “

looking down” and

“

looking straight”

movements, and eye glances include “

left shoulder”

, “

front”

, “

rear-view mirror”

glances.

15. The method of claim 1, further comprising detecting and characterizing a face and determining its pose from an image of the video.

16. The method of claim 15, further comprising detecting facial symmetry and finding eye positions

17. The method of claim 15, further comprising tracking facial features and determining face pose.

18. The method of claim 1, further comprising performing motion-based video segmentation.

19. The method of claim 1, further comprising performing key frame detection.

20. The method of claim 1, further comprising performing interpreting driver head movements from feature point trajectories in the video.