Interface with gaze detection and voice input
First Claim
1. A method for interfacing with a computer program executing on a computing device, the method comprising:
- presenting a character on a display;
determining if a point of gaze (POG) of a user is on the display;
setting the character to present a first behavior when the POG is determined to be on the display, wherein the first behavior provides an impression of awareness of the user by the character, wherein a gaze of the character is maintained toward the user and tracked while the POG of the user is on the character, wherein the tracking causes the character to show motion that enables the maintaining of the gaze of the character toward the user;
setting the character to present a second behavior when the POG is determined to be away from the display, wherein the second behavior provides an impression that the character is not interacting with the user, wherein the gaze of the character is not tracked while the POG of the user is away from the character, wherein the computer program processes voice commands from the user when operating in the first behavior, and wherein the computer program omits processing of voice commands when operating in the second behavior; and
setting the character to operate in a third behavior when multiple users are detected, wherein the character, when operating in the third behavior, performs a validation operation after receiving a voice command, the validation operation including asking a question to the user to validate the voice command, wherein the validation operation is not performed when the voice command is received while the character is presenting the first behavior.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, computer programs, and systems for interfacing a user with a computer program, utilizing gaze detection and voice recognition, are provided. One method includes an operation for determining if a gaze of a user is directed towards a target associated with the computer program. The computer program is set to operate in a first state when the gaze is determined to be on the target, and set to operate in a second state when the gaze is determined to be away from the target. When operating in the first state, the computer program processes voice commands from the user, and, when operating in the second state, the computer program omits processing of voice commands.
133 Citations
19 Claims
-
1. A method for interfacing with a computer program executing on a computing device, the method comprising:
-
presenting a character on a display; determining if a point of gaze (POG) of a user is on the display; setting the character to present a first behavior when the POG is determined to be on the display, wherein the first behavior provides an impression of awareness of the user by the character, wherein a gaze of the character is maintained toward the user and tracked while the POG of the user is on the character, wherein the tracking causes the character to show motion that enables the maintaining of the gaze of the character toward the user; setting the character to present a second behavior when the POG is determined to be away from the display, wherein the second behavior provides an impression that the character is not interacting with the user, wherein the gaze of the character is not tracked while the POG of the user is away from the character, wherein the computer program processes voice commands from the user when operating in the first behavior, and wherein the computer program omits processing of voice commands when operating in the second behavior; and setting the character to operate in a third behavior when multiple users are detected, wherein the character, when operating in the third behavior, performs a validation operation after receiving a voice command, the validation operation including asking a question to the user to validate the voice command, wherein the validation operation is not performed when the voice command is received while the character is presenting the first behavior. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for controlling interfacing reactions with game objects produced by a computer program and rendered on a display, comprising:
-
detecting presence of a user in a zone defined in front of an image capture device; presenting a character on a display; determining if a point of gaze (POG) of the user is on the character on the display; setting the character to present a first behavior when the POG is on the character on the display, wherein the first behavior provides an impression of awareness of the user by the character, wherein a gaze of the character is maintained toward the user and tracked while the POG of the user is on the character, wherein the tracking causes the character to show motion that enables the maintaining of the gaze of the character toward the user, the first behavior including processing of user voice commands by the computer program to perform actions on the character; setting the character to present a second behavior when the POG is away from the character, wherein the second behavior provides an impression that the character is not interacting with the user, wherein the gaze of the character is not tracked while the POG of the user is away from the character, the second behavior including an omission of processing of user voice commands by the computer program; and setting the character to operate in a third behavior when multiple users are detected, wherein the character, when operating in the third behavior, performs a validation operation after receiving a voice command, the validation operation including asking a question to the user to validate the voice command, wherein the validation operation is not performed when the voice command is received while the character is presenting the first behavior. - View Dependent Claims (12, 13, 14, 15)
-
-
16. An apparatus with a visual interface for capturing user input to a computer program executing on a computing device, the apparatus comprising:
-
a camera that captures images of a user situated in front of a display, the computer program presenting a character on the display; a gaze detection module that determines if a point of gaze (POG) of a user is directed towards the character on the display based on the captured images, wherein the computer program sets the character to present a first behavior when the POG is on the character on the display, and wherein the computer program sets the character to present a second behavior when the gaze is determined to be away from the character on the display, wherein the first behavior provides an impression of awareness of the user by the character, wherein a gaze of the character is maintained toward the user and tracked while the POG of the user is on the character on the display, wherein the tracking causes the character to show motion that enables the maintaining of the gaze of the character toward the user, wherein the gaze of the character is not tracked while the POG of the user is away from the character on the display, wherein the second behavior provides an impression that the character is not interacting with the user, and wherein the computer program sets the character to operate in a third behavior when multiple users are detected; and a voice command processing module that receives voice commands from the user, wherein the computer program processes the voice commands from the user when operating in the first behavior to perform actions on the character, wherein the computer program omits processing of the voice commands when operating in the second behavior, and wherein the computer program performs a validation operation after receiving a voice command from the user when the character is operating in the third behavior, the validation operation including asking a question to the user to validate the voice command, wherein the validation operation is not performed when the voice command is received while the character is presenting the first behavior. - View Dependent Claims (17, 18, 19)
-
Specification