Speech interface for an automated endoscope system
First Claim
Patent Images
1. A voice recognition system for use with a surgical instrument, the system comprising:
- a processor coupled to a microphone and to a memory, the processor having a first state and a second state;
wherein the microphone receives a plurality of spoken surgical instructions, each of the spoken surgical instructions including a spoken qualifier and a spoken command, the plurality of spoken surgical instructions including a first surgical instruction having a first spoken qualifier and a first spoken command;
wherein the memory stores a first plurality of allowable commands associated with the second state of the processor; and
wherein in the first state, the processor is configured to;
receive the first surgical instruction and determine if the first spoken qualifier included in the first surgical instruction satisfies a first condition;
if the first spoken qualifier satisfies the first condition, then advance to the second state; and
if the first spoken qualifier does not satisfy the first condition, then remain in the first state; and
wherein in the second state, the processor is configured to;
determine whether the first spoken command included in the first surgical instruction is among the first plurality of allowable commands associated with the second state; and
if the first spoken command is among the first plurality of allowable commands, then transmit a first command signal to the surgical instrument in response to the first spoken command being among the first plurality of allowable commands.
2 Assignments
0 Petitions
Accused Products
Abstract
A robotic system which controls the movement of a surgical instrument in response to voice commands from the user. The robotic system has a computer controlled arm that holds the surgical instrument. The user provides voice commands to the computer through a microphone. The computer contains a phrase recognizer that matches the user'"'"' speech with words stored in the computer. Matched words are then processed to determine whether the user has spoken a robot command. If the user has spoken a recognized robot command the computer will move the robotic arm in accordance with the command.
-
Citations
26 Claims
-
1. A voice recognition system for use with a surgical instrument, the system comprising:
-
a processor coupled to a microphone and to a memory, the processor having a first state and a second state; wherein the microphone receives a plurality of spoken surgical instructions, each of the spoken surgical instructions including a spoken qualifier and a spoken command, the plurality of spoken surgical instructions including a first surgical instruction having a first spoken qualifier and a first spoken command; wherein the memory stores a first plurality of allowable commands associated with the second state of the processor; and wherein in the first state, the processor is configured to; receive the first surgical instruction and determine if the first spoken qualifier included in the first surgical instruction satisfies a first condition; if the first spoken qualifier satisfies the first condition, then advance to the second state; and if the first spoken qualifier does not satisfy the first condition, then remain in the first state; and wherein in the second state, the processor is configured to; determine whether the first spoken command included in the first surgical instruction is among the first plurality of allowable commands associated with the second state; and if the first spoken command is among the first plurality of allowable commands, then transmit a first command signal to the surgical instrument in response to the first spoken command being among the first plurality of allowable commands. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 20, 21, 22, 23, 26)
-
-
13. A method comprising:
-
receiving a spoken surgical instruction, the spoken surgical instruction comprising a verbal qualifier and a verbal control command, wherein the verbal qualifier precedes the verbal control command; determining whether the verbal qualifier matches an expected qualifier associated with a medical device; if the verbal qualifier matches the expected qualifier, then determining whether the verbal control command is among one or more predefined commands from a library of multiple predefined commands; and providing an output command signal that corresponds to the verbal control command to the medical device only if the verbal qualifier matches the expected qualifier and the verbal control command is among the one or more predefined commands. - View Dependent Claims (14, 15, 16, 17)
-
-
18. A voice recognition system for use with a surgical instrument, the system comprising:
-
a microphone for inputting a plurality of spoken surgical instructions, each of the spoken surgical instructions including a spoken qualifier and a spoken command, the plurality of spoken surgical instructions including a first instruction comprising a first spoken qualifier and a first spoken command, wherein the first spoken command comprises a first portion and a second portion; a memory for storing a first plurality of allowable commands and a second plurality of allowable compounds; and a processor coupled to the microphone and the memory, the processor having a first state, a second state, and a third state, wherein the first plurality of allowable commands are associated with the second state, wherein the second plurality of allowable commands are associated with the third state, and wherein the processor is configured to; in the first state, in response to the first spoken qualifier matching an expected qualifier, advance to the second state; in the second state, determine if the first portion of the first spoken command is among the first plurality of allowable commands associated with the second state and to advance to the third state in response to the first portion being among the first plurality of allowable commands; in the third state, determine if the second portion of the first spoken command is among the second plurality of allowable commands associated with the third state; and in response to the second portion of the first spoken command being among the second plurality of allowable commands provide a first command signal to the surgical instrument corresponding to the first spoken command.
-
-
19. A method for controlling a surgical instrument, the method comprising:
-
in a first state, receiving a plurality of spoken surgical instructions, each of the spoken surgical instructions including a spoken qualifier and a spoken command, the plurality of spoken surgical instructions including a first surgical instruction having a first spoken qualifier and a first spoken command; determining if the first spoken qualifier included in the first surgical instruction satisfies a first condition; if the first spoken qualifier satisfies the first condition, then advancing to a second state; in the second state, determining whether the first spoken command included in the first surgical instruction is among a plurality of allowable commands associated with the second state; and if the first spoken command is among the first plurality of allowable commands, then transmitting a first command signal to the surgical instrument in response to the first spoken command being among the plurality of allowable commands.
-
-
24. A method comprising:
-
receiving a first spoken surgical instruction, the first spoken surgical instruction comprising a verbal qualifier and a first verbal control command, the verbal qualifier preceding the first verbal control command; determining whether the verbal qualifier matches an expected qualifier; if the verbal qualifier matches the expected qualifier, then determining whether the first verbal control command is among one or more predefined commands from a first library of multiple predefined commands; providing a first output command signal that corresponds to the first verbal control command to a medical device only if the verbal qualifier matches the expected qualifier and the first verbal control command is among the predefined commands in the first library; receiving a second spoken surgical instruction, the second spoken surgical instruction comprising the verbal qualifier and a second verbal control command, the verbal qualifier preceding the second verbal control command; determining whether the verbal qualifier matches the expected qualifier; if the verbal qualifier matches the expected qualifier, then determining whether the second verbal control command is among one or more predefined commands from a second library of multiple predefined commands; and providing a second output command signal that corresponds to the second verbal control command to the medical device only if the verbal qualifier matches the expected qualifier and the second verbal control command is among the predefined commands in the second library.
-
-
25. A method comprising:
-
receiving a spoken surgical instruction, the spoken surgical instruction comprising a verbal qualifier and a verbal control command comprising a first part and a second part, the verbal qualifier preceding the verbal control command; determining whether the verbal qualifier matches an expected qualifier; if the verbal qualifier matches the expected qualifier, then determining whether the first part of the verbal control command is among one or more predefined commands from a first library of multiple predefined commands; if the first part of the verbal control command is among the predefined commands in the first library, then determining whether the second part of the verbal control command is among one or more predefined commands in a second library of multiple predefined commands; and providing an output command signal to a medical device, wherein the output command signal corresponds to the first and second parts of the verbal control command only if;
the verbal qualifier matches the expected qualifier, the first part of the verbal control command is among the predefined commands in the first library, and the second part of the verbal control command is among the predefined commands in the second library.
-
Specification