Method for hands-free operation of a pointer

• US 6,519,566 B1
• Filed: 03/01/2000
• Issued: 02/11/2003
• Est. Priority Date: 03/01/2000
• Status: Expired due to Term

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Tan, Ji Wee, Lewis, James R., Ortega, Kerry A., Boyer, Linda M.
• Primary Examiner(s): Dorvil, Richemond
• Application Number:
  US09/516,694
• Time in Patent Office: 1,077 Days
• Field of Search: 704/270, 704/275, 704/272
• US Class Current: 704/275
• CPC Class Codes: G06F 3/04892 Arrangements for controlling cursor position based on codes indicative of cursor displacements from one discrete location to another, e.g. using cursor control keys associated to different directions or using the tab key arrangements for controlling cursor position based on coordinate signals G06F3/038
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

The method of the invention involves a plurality of steps including, defining a set of user voice commands for hands-free control of a pointer and, in response to receiving a first audio input recognized as one of the set of user voice commands, initiating motion of the pointer in a direction indicated by the user voice command. Subsequently, in response to receiving a second audio input, the pointer motion can be discontinued. Finally, in response to receiving one or more subsequent audio inputs not recognized as being among the set of user voice commands, the pointer can be incrementally moved responsive to the subsequent audio inputs.

Claims

1. In a computer system having a speech recognition engine for processing audio input, a hands-free method of controlling a pointer comprising:

defining a set of user voice commands for hands-free control of said pointer;

in response to receiving a first audio input recognized as a user voice command included in said defined set of user voice commands, initiating motion of said pointer in a direction indicated by said user voice command;

in response to receiving a second audio input, discontinuing said pointer motion; and

,

in response to receiving one or more subsequent audio inputs not recognized as being user voice commands included in said defined set of user voice commands, incrementally moving said pointer responsive to said subsequent audio inputs until an audio input recognized as being a user voice command is received.

2. The method according to claim 1, further comprising changing an appearance of said pointer from a default appearance to a modified appearance prior to receiving said first audio input.

3. The method according to claim 1, wherein each of said subsequent audio inputs is one of an audio input recognized as a user voice command included in said defined set of user voice commands, and an audio input not recognized as being included in said defined set of user voice commands.

4. The method according to claim 3, further comprising:

if one of said subsequent audio inputs is an audio input recognized as a user voice command included in said defined set of user voice commands, moving said pointer to a location on screen where said pointer existed when said subsequent audio input recognized as a user voice command was first received.

5. The method according to claim 4, further comprising executing said user voice command received in said second receiving step.

6. The method according to claim 4, further comprising the step of detecting a pause of a predetermined duration between said subsequent audio inputs not recognized as a user voice command and said subsequent audio input recognized as a user voice command.

7. The method according to claim 1, wherein said incremental motion varies according to a measured volume of said subsequent audio input.

8. The method according to claim 1, wherein said first receiving step further comprises:

receiving at least one parameter associated with said user voice command; and

,

controlling said pointer movement according to said at least one parameter.

9. The method according to claim 1, wherein said pointer motion is controlled in one or more software in said computer system.

10. The method according to claim 1, wherein said pointer motion is controlled in a software application not equipped with accessibility features.

11. The method according to claim 1, wherein said pointer motion is controlled in an operating system.

12. In a computer system having a speech recognition engine for processing audio input, a hands-free method of controlling a pointer comprising:

accepting a command-mode voice command recognized as being among a predefined set of user voice commands for controlling said pointer;

in response to an audio input, transitioning from said command-mode to an idle-mode for fine positioning said pointer; and

,

incrementally moving said pointer in said idle-mode in response to audio inputs not recognized as being among said predefined set of user voice commands for controlling said pointer, each incremental movement occurring concurrently with a corresponding audio input.

13. The method according to claim 12, wherein said transitioning step comprises:

monitoring said speech recognition engine for said audio input;

determining if said audio input is one of a command not recognized as a user voice command included in said predefined set of user voice commands, an idlemode command and a specific command for selecting idle-mode; and

,

if said audio input is one of a command not recognized as a user voice command included in said predefined set of user voice commands, an idle-mode command and a specific command for selecting idle mode, discontinuing pointer motion caused by said command-mode command.

14. The method according to claim 13, wherein said audio input is one of an audio input recognized as being among said predefined set of user voice commands for controlling said pointer, and an audio input not recognized as being among said predefined set of user voice commands for controlling said pointer.

15. The method according to claim 14, further comprising:

if said audio input is recognized as a user voice command included in said set of user voice commands for controlling said pointer, moving said pointer to a location on screen where said pointer existed when said user voice command was first received.

16. The method according to claim 15, further comprising the step of executing said user voice command received in said transitioning step.

17. The method according to claim 12, further comprising the step of changing an appearance of said pointer from a default appearance to a modified appearance prior to receiving said first audio input.

18. The method according to claim 12, wherein each of said audio inputs is one of an audio input recognized as being among said predefined set of user voice commands for controlling said pointer, and an audio input not recognized as being among said predefined set of user voice commands for controlling said pointer.

19. The method according to claim 12, wherein said incremental motion varies according to a measured volume of said audio inputs.

20. A machine readable storage, having stored thereon a computer program having a plurality of code sections executable by a machine for causing the machine to perform the steps of:

defining a set of user voice commands for hands-free control of a pointer;

in response to receiving a first audio input recognized as a user voice command included in said defined set of user voice commands, initiating motion of said pointer in a direction indicated by said user voice command;

in response to receiving a second audio input, discontinuing said pointer motion; and

,

in response to receiving one or more subsequent audio inputs not recognized as being user voice commands included in said defined set of user voice commands, incrementally moving said pointer responsive to said subsequent audio inputs until an audio input recognized as being a user voice command is received.

21. The machine readable storage according to claim 20, further comprising changing an appearance of said pointer from a default appearance to a modified appearance prior to receiving said first audio input.

22. The machine readable storage according to claim 20, wherein each of said subsequent audio inputs is one of an audio input recognized as a user voice command included in said defined set of user voice commands, and an audio input not recognized as being a user voice command included in said defined set of user voice commands.

23. The machine readable storage according to claim 22, further comprising:

if one of said subsequent audio inputs is an audio input recognized as a user voice command included in said defined set of user voice commands, moving said pointer to a location on screen where said pointer existed when said subsequent audio input recognized as a user voice command was first received.

24. The machine readable storage according to claim 23, further comprising executing said user voice command received in said second receiving step.

25. The machine readable storage according to claim 23, further comprising detecting a pause of a predetermined duration between said subsequent audio inputs not recognized as a user voice command and said subsequent audio input recognized as a user voice command.

26. The machine readable storage according to claim 20, wherein said incremental motion varies according to a measured volume of said subsequent audio input.

27. The machine readable storage according to claim 20, wherein said step of receiving a first audio input recognized as a user voice command further comprises:

receiving at least one parameter associated with said user voice command; and

,

controlling said pointer movement according to said at least one parameter.

28. The machine readable storage according to claim 20, wherein said pointer motion is controlled in one or more software in said computer system.

29. The machine readable storage according to claim 20, wherein said pointer motion is controlled in a software application not equipped with accessibility features.

30. The machine readable storage according to claim 20, wherein said pointer motion is controlled in an operating system.