Communication system user interface with animated representation of time remaining for input to recognizer

• US 6,018,711 A
• Filed: 04/21/1998
• Issued: 01/25/2000
• Est. Priority Date: 04/21/1998
• Status: Expired due to Term

• Current Assignee: Avaya Incorporated
• Original Assignee: Nortel Networks Corporation
• Inventors: Roberts, Jobe L.W., Trasmundi, Frederic Fernand, French-St. George, Marilyn
• Primary Examiner(s): Hudspeth, David R.
• Assistant Examiner(s): Smits, Talivaldis Ivars
• Application Number:
  US09/063,007
• Time in Patent Office: 644 Days
• Field of Search: 704/270, 704/275, 455/231
• US Class Current: 704/275
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

A system and method for management of an interface for communications systems and devices using a recognizer having a limited time duration recognition window, based on mapping available time to a spatial representation. The system has particular application to management of a speech interface for a speech recognizer with a limited time duration recognition window. When the speech recognizer is on and a recognition window is opened, a timing signal is sent to the device and processed to provide spatial representation of the time remaining, e.g. in the form of an animation on a graphical user interface, or a recognizable pattern of stimulation using a haptic interface. As the recognition window advances and closes, the animation or pattern also changes and closes, e.g. diminishes in size, to provide the user with spatial information indicative of the time left in the recognition window. A reset feature allows users to reopen the recognition window to delete and correct input, while the window is still open, or after closing the window, and before the system advances to an erroneous state. The system is particularly applicable to speech recognizers having a limited recognition window that access speech recognition engines resident on a network or at a terminal device.

Claims

1. A communications system comprising:

an interface operable for receiving input during limited time recognition window,

means for mapping available time of the recognition window to a spatial representation in animated form using one of a graphical modality, haptic modality or auditory modality.

2. A system according to claim 1 wherein the spatial representation comprises one of a two dimensional representation and three dimensional representation which diminishes in size as the available time diminishes.

3. A system according to claim 1 wherein the means for mapping comprises a graphical user interface and the spatial representation comprises graphical information in the form of an animation.

4. A system according to claim 3 wherein the animation diminishes in size as the available time diminishes.

5. A system according to claim 4 wherein the rate of change of the animation is linear.

6. A system according to claim 4 wherein the rate of change of animation is non-linear.

7. A system according to claim 1 wherein the means for mapping comprises a haptic interface and the spatial representation comprises an animated pattern of haptic stimulation.

8. A system according to claim 1 wherein the means for mapping comprises an auditory interface the spatial representation comprises an time dependent auditory pattern.

9. A system according to claim 1 comprising reset means for resetting the recognition window and reinitiating the animation.

10. A communications device comprising:

an speech interface for accessing a speech recognizer operable for receiving speech input during limited time recognition window, and

means for mapping available time of the recognition window to a spatial representation in animated form using one of a graphical modality, haptic modality or auditory modality.

11. A communications system comprising:

a speech interface for accessing a speech recognizer operable for receiving speech input during limited time recognition window,

means for mapping available time of the recognition window to a spatial representation in animated form using one of a graphical modality, haptic modality or auditory modality.

12. A system according to claim 11 wherein the means for mapping comprises a graphical user interface and the spatial representation comprises a graphical animation.

13. A communications system according to claim 12 comprising means for resetting the recognition window.

14. A communications system according to claim 13 wherein the means for resetting the recognition window comprises a tactile input means associated with the animation displayed on the graphical user interface.

15. A communications system according to claim 13 wherein the animation is provided by a touch sensitive region of the graphical user interface, and the means for resetting the recognition window comprises an associated touch sensitive region of the graphical user interface.

16. A system according to claim 11 wherein the spatial representation comprises one of a two dimensional representation and three dimensional representation which diminishes in size as the available time diminishes.

17. A system according to claim 11 wherein the means for mapping comprises a haptic interface and the spatial representation comprises an animated pattern of haptic stimulation.

18. A system according to claim 11 wherein the animation diminishes in size as the available time diminishes.

19. A system according to claim 18 wherein the rate of change in size of the animation is linear.

20. A system according to claim 18 wherein the rate of change in size of animation is non-linear.

21. A system according to claim 11 wherein the animation is indicative of the operation of the recognition window, and the animation changes during the operation of the recognition window to indicate the remaining time duration of the recognition window.

22. A method of providing user feedback and control for a communications device for accessing a recognizer for receiving input while the recognizer is operable during a limited time duration recognition, comprising the steps of:

after prompting the user for input;

turning on the recognizer for a limited time duration recognition window;

and while the speech recognizer is on, mapping available time to a spatial representation in animated form in one of a graphical modality, haptic modality and auditory modality.

23. A method according to claim 22 wherein the interface comprises a graphical user interface and the method comprises providing a spatial representation in the form of an graphical animation indicative of the time remaining in the recognition window.

24. A method according to claim 23 comprising displaying an animation which diminishes in size as the time remaining in the recognition window decreases.

25. A method of providing user feedback and control for a communications device having a speech interface for accessing a speech recognizer, the speech recognizer being operable for receiving input during a limited time duration recognition window, comprising the steps of:

after prompting the user for input;

turning on the recognizer for a limited time duration recognition window;

and while the speech recognizer is on, mapping available time to a spatial representation in animated form using one of a graphical modality, haptic modality and auditory modality.

26. A method according to claim 25 wherein the interface comprises a graphical user interface and the method comprises providing a spatial representation in the form of an graphical animation indicative of the time remaining in the recognition window.

27. A method according to claim 26 comprising displaying an animation which diminishes in size as the time remaining in the recognition window decreases.

28. A method according to claim 27 comprising,

while the speech recognizer is on, generating a timing signal representative of the time remaining in the recognition window,

controlling the animation using the timing signal and

at each time increment of the timing signal capturing speech input, and checking for user input to a reset means,

and when user input to the reset means is captured, resetting the recognition window, deleting captured speech input, and reinitiating the timing signal and the animation,

and when the timing signal corresponds to the end of the recognition window, capturing aggregated speech input and closing the recognition window.

29. Software on a computer readable medium for carrying out a method of providing user feedback and control for a communications device having a speech interface for accessing a speech recognizer, the speech recognizer being operable for receiving input during a limited time duration recognition window, comprising the steps of:

after prompting the user for input;

turning on the recognizer for a limited time duration recognition window;

and while the speech recognizer is on, mapping available time to a spatial representation in animated form using one of a graphical modality, haptic modality and auditory modality.