Generating visual feedback signals for eye-tracking controlled speech processing
First Claim
Patent Images
1. A monitoring and operating system, comprising:
- detection means for detecting a visual field of a user being directed onto a display;
speech recognition means for recognizing speech information of the user;
control means for controlling the system; and
means for generating a visual feedback signal relating to a processing status of the speech information of the user, wherein the visual feedback signal comprises a color signal that identifies the processing status of the speech information of the user, wherein the color signal comprises a plurality of colors, each of the plurality of colors respectively identifying one of a plurality of processing statuses, and wherein the plurality of processing statuses include a status indicating that the speech information is recognized and a corresponding action has been performed, a status indicating that the speech information is not recognized, and a status indicating that the speech information is recognized, but a corresponding action has not yet been executed.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and a method for operating and monitoring, in particular, an automation system and/or a production machine or machine tool. The visual field (9) of a user (1) directed onto at least one display (2) is recorded. Speech information (8) from the user (1) is at least intermittently determined and a visual feedback signal is generated in response to a processing status regarding the determined speech information (8). An improved speech interaction is thus obtained, in particular, in the field of augmented-reality applications and in complex technical plants.
34 Citations
10 Claims
-
1. A monitoring and operating system, comprising:
-
detection means for detecting a visual field of a user being directed onto a display;
speech recognition means for recognizing speech information of the user;
control means for controlling the system; and
means for generating a visual feedback signal relating to a processing status of the speech information of the user, wherein the visual feedback signal comprises a color signal that identifies the processing status of the speech information of the user, wherein the color signal comprises a plurality of colors, each of the plurality of colors respectively identifying one of a plurality of processing statuses, and wherein the plurality of processing statuses include a status indicating that the speech information is recognized and a corresponding action has been performed, a status indicating that the speech information is not recognized, and a status indicating that the speech information is recognized, but a corresponding action has not yet been executed. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method for monitoring and operating a system comprising:
-
detecting that a user'"'"'s view is directed onto a display;
at least intermittently recognizing speech information spoken by the user;
generating a visual feedback signal that indicates a processing status regarding the speech information spoken by the user, wherein the visual feedback signal comprises a color signal identifying the processing status of the speech information, and identifying one of a plurality of processing statuses by one of a plurality of colors, wherein the plurality of processing statuses include a status indicating that the speech information is recognized and a corresponding action has been performed, a status indicating that the speech information is not recognized, and a status indicating that the speech information is recognized, but a corresponding action has not yet been executed. - View Dependent Claims (7, 8, 9, 10)
-
Specification