Task automation user interface with text-to-speech output

• US 6,456,973 B1
• Filed: 10/12/1999
• Issued: 09/24/2002
• Est. Priority Date: 10/12/1999
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ruback, Harvey, Guasti, Peter J., Nassiff, Amado, Fado, Frank, VanBuskirk, Ronald E.
• Primary Examiner(s): {haeck over (S)}mits, Ta̅livaldis Ivars
• Assistant Examiner(s): McFadden, Susan
• Application Number:
  US09/416,687
• Time in Patent Office: 1,078 Days
• Field of Search: 704/260, 704/270, 704/275, 379/88.02, 345/156, 345/716
• US Class Current: 704/260
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems

Abstract

In a computer system adapted for text-to-speech playback, a method for instructing a user in performing a task having a plurality of steps can include retrieving a textual instruction from a location in an electronic storage device of the computer system. The textual instruction can correspond to one or more of the steps in the task. The textual instruction can be displayed in a task automation user interface, and a text-to-speech (TTS) conversion of the textual instruction can be executed. The steps can be repeated until all textual instructions corresponding to each step in the task have been retrieved and TTS converted.

Claims

1. In a computer system adapted for text-to-speech playback, a method for instructing a user in performing a computer related task having a plurality of steps, said method comprising the Steps of

(a) displaying a task automation graphical user interface having at least a first portion for displaying textual instructions, and a second portion for controlling text-to-speech playback (TTS) of said textual instructions;

(b) retrieving a textual instruction from a location in an electronic storage device of said computer system, said textual instruction corresponding to at least one of said steps in said task;

(c) displaying said textual instruction in said first portion of said task computer related automation graphical user interface;

,

(d) executing a text-to-speech (TTS) conversion of said textual instruction; and

,

(e) repeating steps.(b)-(d) until all textual instructions Corresponding to each step in said computer related task have been retrieved and TTS converted.

2. The method according to claim 1, further comprising the steps of:

receiving from said user data input for performing said step; and

, executing a TTS conversion of said received user data.

3. The method according to claim 2, wherein said user data input is playback control input identifying a next textual instruction for retrieving, displaying in said first portion of said task automation graphical user interface and executing said TTS conversion.

4. The method according to claim 1, further comprising the steps of receiving playback control input from said user;

and, performing steps (b)-(e) responsive to said control input.

5. The method according to claim 4, wherein said playback control input is a voice command issued by said user.

6. The method according to claim 4, wherein said playback control input is one of a keyboard input and a pointing device input.

7. The method according to claim 4, wherein said playback control is at least one of the functions for controlling a conventional audio cassette tape player.

8. The method according to claim 1, wherein said executing step comprises the steps of:

converting said textual instruction to audio signals; and

,

processing said audio signals to produce audible TTS playback output.

9. The method according to claim 8, wherein said audible TTS playback output emphasizes portions of said textual instruction.

10. The method according to claim 8, wherein said displaying step comprises the step of displaying said textual instruction substantially as said textual instruction is output audibly.

11. The method according to claim 1, furthers comprising the steps of providing a graphical actor in a third portion of said task automation graphical user interface;

animating said graphical actor; and

,

choreographing said animating step with said executing step so as to give an appearance of said graphical actor speaking to said user.

12. A computer system adapted for text-to-speech playback to instruct a user in performing a computer related task having a plurality of steps, comprising:

a task automation graphical user interface having at least a first portion for displaying textual instructions, and a second portion for controlling text-to-speech playback (TTS) of said textual instructions;

acquisition means for acquiring a textual instruction from a location in an electronic storage device of said computer system, said textual instruction corresponding to at least one of said steps in said computer related task;

display means for displaying said textual instruction in said first portion of said task automation graphical user interface;

a text-to-speech (TTS) engine software application for converting said textual instruction to audio signals;

processor means for processing said audio signals; and

,

reproduction means for performing audible TTS playback output according to said processed audio signals.

13. The system according to claim 12, further comprising input means for receiving from said user data input for performing said step, wherein said user data input is converted to audio signals for audible playback output.

14. The system according to claim 13, wherein said user data input comprises playback control input for identifying a next textual instruction for acquiring, displaying in said first portion of said task automation graphical user interface and executing said TTS conversion.

15. The system according to claim 12, further comprising input means for receiving playback control input from said user, wherein said reproduction means performs audible TTS playback output responsive to said control input.

16. The system according to claim 15, further comprising a speech recognition engine, wherein said playback control input is a voice command issued to said speech recognition engine by said user.

17. The system according to claim 15, wherein said playback control input is one of a keyboard input and a pointing device input.

18. The system according to claim 15, wherein said playback control input comprises at least one of the functions for controlling a conventional audio cassette tape player.

19. The system according to claim 15, wherein said playback control input comprises at least one of a play control, stop control, pause control, forward control or rewind control.

20. The system according to claim 12, wherein said audible TTS playback output emphasizes portions of said textual instruction.

21. The system according to claim 12, wherein said textual instruction is displayed substantially as said textual instruction is output audibly.

22. The system according to claim 12, further comprising:

means for providing a graphical actor in a third portion of said task automation graphical user interface;

animation means for animating said graphical actor; and

,

choreography means for synchronizing said animation of said graphical actor with said audible TTS playback output so as to give an appearance of said graphical actor speaking to said user.

23. A machine readable storage, having stored thereon a computer program having a plurality of code sections executable by a machine for causing the machine to perform the steps of:

(a) displaying a task automation graphical user interface having at least a first portion for displaying textual instructions, and a second portion for controlling text-to speech playback (TTS) of said textual instructions;

(b) retrieving a textual instruction for performing a computer related task from a location in an electronic storage device, said textual instruction corresponding to at least one of a plurality of steps in said computer related task;

(c) displaying said textual instruction in said first portion of said task autornation graphical user interface;

(d) executing a text-to-speech (TTS) conversion of said textual instruction; and

,

(e) repeating steps,(b)-(d) until all textual instructions corresponding to each step in said computer related task have been retrieved and TTS converted, whereby steps (a)-(e) audibly and visually instruct said user in performing said computer related task.

24. The machine readable storage according to claim 23, having a program causing the machine to perform the further steps of:

receiving from said user data input for performing said step; and

,

executing a TTS conversion of said received user data.

25. The machine readable storage according to claim 23, shaving a program causing the machine to perform the further steps of:

receiving playback control input from said user; and

,

performing steps (b)-(e) responsive to said control input.

26. The machine readable storage according to claim 23, having a program causing the machine to perform the further steps of:

providing a graphical actor in a third portion of said task automation graphical user interface;

animating said graphical actor; and

,

choreographing said animating step with said executing step so as to give an appearance of said graphical actor speaking to said user.