Multipurpose controller for electronic devices, facial expressions management and drowsiness detection
First Claim
1. A system for controlling an electronic device, the system comprising:
- a microprocessor running control software for;
receiving a first signal indicative of a facial expression of a user;
receiving a second signal indicative of motion or position of a part of the user'"'"'s body; and
generating a motion command for moving an object of interest on the electronic device based on the second signal; and
a communication link for transmitting the motion command to the electronic device;
wherein the control software;
detects an active facial expression based on the first signal;
starts generating the motion command when the active facial expression is detected for at least a first minimum time duration; and
stops generating the motion command when the active facial expression is no longer detected.
1 Assignment
0 Petitions
Accused Products
Abstract
A hands-free controller, a facial expression management system, a drowsiness detection system and methods for using them are disclosed. The controller monitors facial expressions of the user, monitors motions of the user'"'"'s body, generates commands for an electronic device based on the monitored facial expressions and body motions, and communicates the commands to the electronic device. Monitoring facial expressions can include sensing facial muscle motions using facial expression sensors. Monitoring user body motions can include sensing user head motions. Facial expression management can includes monitoring user facial expressions, storing monitored expressions, and communicating monitored expressions to an electronic device. Drowsiness detection can include monitoring eye opening of the user, generating an alert when drowsiness is detected, monitoring proper usage of the device, and generating a warning when improper usage is detected.
-
Citations
85 Claims
-
1. A system for controlling an electronic device, the system comprising:
-
a microprocessor running control software for; receiving a first signal indicative of a facial expression of a user; receiving a second signal indicative of motion or position of a part of the user'"'"'s body; and generating a motion command for moving an object of interest on the electronic device based on the second signal; and a communication link for transmitting the motion command to the electronic device; wherein the control software; detects an active facial expression based on the first signal; starts generating the motion command when the active facial expression is detected for at least a first minimum time duration; and stops generating the motion command when the active facial expression is no longer detected. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 24, 25, 26, 27, 28, 29, 30, 33, 34, 35, 36, 37, 38, 39, 40, 41, 71, 72, 78)
-
-
22. A system for controlling an electronic device, the system comprising:
-
a microprocessor running control software for; receiving a first signal indicative of a facial expression of a user; receiving a second signal indicative of motion or position of a part of the user'"'"'s body; and generating a selection command based on the first signal; and a communication link for transmitting the selection command to the electronic device; wherein the control software generates the selection command when the first signal crosses and stays beyond a second start threshold for more than a first minimum selection hold time and less than a first maximum selection hold time. - View Dependent Claims (42, 43, 44, 45, 46, 47, 48, 49, 50, 80, 81, 82, 83, 84, 85)
-
-
23. A system for controlling an electronic device, the system comprising:
-
a microprocessor running control software for; receiving a first signal indicative of a facial expression of a user; receiving a second signal indicative of motion or position of a part of the user'"'"'s body; and generating a click and drag command for moving an object of interest on the electronic device; and a communication link for transmitting the click and drag command to the electronic device; wherein the control software; starts the click and drag command when the first signal crosses and stays beyond a third start threshold for more than a second minimum selection hold time and the second signal stays below a first motion or position threshold; after starting the click and drag command, moves the object of interest on the electronic device based on the second signal while the first signal continues to stay beyond a third end threshold; and terminates the click and drag command when the first signal crosses the third end threshold. - View Dependent Claims (31, 32, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 73, 74, 75, 76, 77, 79)
-
Specification