METHOD AND SYSTEM FOR MONITORING THE STATUS OF THE DRIVER OF A VEHICLE
First Claim
1. A method for real-time driver state monitoring comprising:
- operating an image processing system to receive a sequence of depth images from a depth sensor, each depth image comprising image data representing an image of a scene, wherein said image data comprises a depth value indicating distance from the depth sensor;
the image processing system identifying a human head in the scene using the sequence of images;
the image processing system using the depth images to track position and orientation of the human head with respect to a principal position and orientation where the human head is modeled as a 3D surface to define a head model and continuously adapted over time to obtain an average neutral face model;
the image processing system identifying depth deviations from the neutral face; and
the image processing system classifying such depth deviations as different driver states.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method are disclosed relating to a computer system that estimates the status of the driver of a vehicle. The system comprises the following steps: Acquisition of an image from a depth sensor containing depth and optional an IR intensity image and an RGB color image; identification of pixels that belong to the drivers head; creation of a 3D model of the head including an intensity model and a variability estimate for depth, grayscale and color information; estimation of the principal head pose and the neutral facial expression; estimation of the current relative head pose with respect to the principal head pose; identification of pixels that do not match the neutral face model with respect to depth, grayscale or color information or any combination thereof; clustering of the pixels with identified deviations; classification of spatial and temporal patterns to identify driver status and distraction events.
-
Citations
18 Claims
-
1. A method for real-time driver state monitoring comprising:
-
operating an image processing system to receive a sequence of depth images from a depth sensor, each depth image comprising image data representing an image of a scene, wherein said image data comprises a depth value indicating distance from the depth sensor; the image processing system identifying a human head in the scene using the sequence of images; the image processing system using the depth images to track position and orientation of the human head with respect to a principal position and orientation where the human head is modeled as a 3D surface to define a head model and continuously adapted over time to obtain an average neutral face model; the image processing system identifying depth deviations from the neutral face; and the image processing system classifying such depth deviations as different driver states. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for real-time driver state monitoring, comprising:
-
a depth sensor to capture depth images of a scene and generate image data representing the image of the scene, wherein said image data comprises a depth value indicating distance from the depth sensor; and an image processing system operatively connected to said sensor to receive a sequence of depth images from the sensor, the image processing system being programmed to identify a human head in the scene using the sequence of images, using the depth images to track position and orientation of the human head with respect to a principal position and orientation where the human head is modeled as a 3D surface to define a head model and continuously adapted over time to obtain an average neutral face model, identifying depth deviations from the neutral face, and classifying such depth deviations as different driver states. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
Specification