System and method for controlling vehicle operation based on a user's facial expressions and physical state
First Claim
1. A method of automatically controlling an operation of a vehicle, comprising:
- receiving facial expression input from an image pickup device, wherein the facial expression input includes images of an operator of the vehicle;
performing facial expression recognition on the facial expression input to identify a particular type of emergency situation from a plurality of possible emergency situations; and
automatically applying a subset of safety operations, from a plurality of safety operations, to a vehicle control module, corresponding to the particular type of emergency situation identified by the facial expression recognition, to thereby control the operation of the vehicle.
2 Assignments
0 Petitions
Accused Products
Abstract
A system and method for controlling vehicle operation based on a driver'"'"'s facial expressions and physical state are provided. In particular, a system and method for differentiating between different types of emergency situations and applying an appropriate set of safety operations to ensure the safety of the driver, any other passengers, and others outside the vehicle are provided. With the system and method, facial expression recognition is used to distinguish between different types of emergency situations. For each of these emergency situations, a predetermined set of safety operations may be established. Once a particular emergency situation is detected based on the facial expression recognition, the corresponding set of safety operations are applied by sending appropriate control signals to vehicle control systems to cause the operation of the vehicle to be modified.
161 Citations
27 Claims
-
1. A method of automatically controlling an operation of a vehicle, comprising:
-
receiving facial expression input from an image pickup device, wherein the facial expression input includes images of an operator of the vehicle;
performing facial expression recognition on the facial expression input to identify a particular type of emergency situation from a plurality of possible emergency situations; and
automatically applying a subset of safety operations, from a plurality of safety operations, to a vehicle control module, corresponding to the particular type of emergency situation identified by the facial expression recognition, to thereby control the operation of the vehicle. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 26)
-
-
14. A system for automatically controlling an operation of a vehicle, comprising:
-
means for receiving facial expression input from an image pickup device, wherein the facial expression input includes images of an operator of the vehicle;
means for performing facial expression recognition on the facial expression input to identify a particular type of emergency situation from a plurality of possible emergency situations; and
means for automatically applying a subset of safety operations, from a plurality of safety operations, to a vehicle control module, corresponding to the particular type of emergency situation identified by the facial expression recognition, to thereby control the operation of the vehicle. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25)
-
-
27. A computer program product in a computer readable medium for automatically controlling an operation of a vehicle, comprising:
-
first instructions for receiving facial expression input from an image pickup device, wherein the facial expression input includes images of an operator of the vehicle;
second instructions for performing facial expression recognition on the facial expression input to identify a particular type of emergency situation from a plurality of possible emergency situations; and
third instructions for automatically applying a subset of safety operations, from a plurality of safety operations, to a vehicle control module, corresponding to the particular type of emergency situation identified by the facial expression recognition, to thereby control the operation of the vehicle.
-
Specification