Voice controllable interactive communication display system and method

• US 20070033047A1
• Filed: 08/05/2005
• Published: 02/08/2007
• Est. Priority Date: 08/05/2005
• Status: Active Grant

• Current Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Original Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Inventors: Jung, Edward, Malamud, Mark, Lord, Robert, Levien, Royce, Rinaldo, John
• Granted Patent: US 9,240,179 B2
• Time in Patent Office: Days
• US Class Current: 704/258
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06F 40/14 Tree-structured documents parsing G06F40/205; validation G06F40/226
• CPC Class Codes: G06F 40/177 of tables; using ruled lines
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser
• CPC Class Codes: G10L 13/047 Architecture of speech synthesisers
• CPC Class Codes: G10L 15/142 Hidden Markov Models [HMMs]
• CPC Class Codes: G10L 15/18 using natural language modelling
• CPC Class Codes: G10L 15/222 Barge in, i.e. overridable guidance for interrupting prompts
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• CPC Class Codes: H04M 1/271 controlled by voice recognition

Abstract

A system and method for use with a voice-capable system, includes but is not limited to receiving a vocal input to the voice-capable system, receiving one or more instructions referential to the first speech output version of the vocal input, and creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions.

Claims

1. A method for a voice-capable system, the method comprising:

receive a vocal input to the voice-capable system;

creating a first speech output version of the vocal output;

receiving one or more instructions referential to the first speech output version of the vocal input; and

creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions.

2. The method of claim 1, wherein the creating a first speech output version of the vocal input includes:

creating a speech representation having a substantially defined fidelity to the vocal input.

3. The method of claim 1, wherein the creating a first speech output version of the vocal input includes:

audibly presenting a speech representation having a substantially defined fidelity to the vocal input.

4. The method of claim 1, wherein the creating a first speech output version of the vocal input includes:

processing the vocal input to enable an audible instruction set to manipulate the first speech output version of the vocal input.

5. The method of claim 4, wherein the processing the vocal input to enable an audible instruction set to manipulate the first speech output version of the vocal input includes:

enabling a user to interact with the audible instruction set, the audible instruction set including one or more commands including one or more of a skip forward command, a reverse command, a delete command, a move command, an undo command, and/or a mark command.

6. The method of claim 4, wherein the processing the vocal input to enable an audible instruction set to manipulate the first speech output version of the vocal input includes:

enabling user interface to navigate the first speech output version of the vocal input via one or more of the audible instruction set and/or a non-audible user interface.

7. The method of claim 1, wherein the creating a first speech output version of the vocal input includes:

processing the vocal input to create the first speech output version of the vocal input, the processing including inserting one or more tags into the first speech output version of the vocal input to enable a user interface.

8. The method of claim 7, wherein the processing the vocal input to create the first speech output version of the vocal input, the processing including inserting one or more tags into the first speech output version of the vocal input to enable a user interface includes:

creating a table of the one or more tags, the table enabling an audible instruction act.

9. The method of claim 7, wherein the processing the vocal input to create the first speech output version of the vocal input, the processing including inserting one or more tags into the first speech output version of the vocal input to enable a user interface includes:

processing the vocal input via a voice XML-based application, the voice XML based application inserting the one or more tags into the first speech output version of the vocal input to enable the user interface to navigate the first speech output version of the vocal input.

10. The method of claim 9, wherein processing the vocal input via a voice XML-based application, the voice XML-based application inserting the one or more tags into the first speech output version of the vocal input to enable the user interface to navigate the first speech output version of the vocal input includes:

enabling the user interface to navigate the first speech output version of the vocal input via one or more of the audible instruction set and/or a non-audible user interface.

12. The method of claim 1, wherein the receiving one or more instructions referential to the first speech output version of the vocal input includes;

receiving an instruction to identify a location in the first speech output version of the vocal input.

13. The method of claim 12, wherein the receiving an instruction to identify a location in the first speech output version of the vocal input includes:

receiving an instruction to move forward in the first speech output version of the vocal input by a number of words/sounds/marks and/or move backward in the first speech output version of the vocal input by a number of words/sounds/marks, the voice-enabled system responding audibly and/or visually to the instruction to identify a location in the first speech output version of the vocal input.

15. The method of claim 1, wherein the receiving one or more instructions referential to the first speech output version of the vocal input includes:

receiving an instruction to expand and/or contract a predetermined length of the first speech output version of the vocal input.

16. The method of claim 15, wherein receiving an instruction to expand and/or contract a predetermined length of the first speech output version of the vocal input includes;

receiving an indication identifying the predetermined length including a starting point and time indication.

17. The method of claim 16, wherein the receiving an indication identifying the predetermined length including a starting point and time indication includes:

receiving the indication as a tag corresponding to a navigation interface.

18. The method of claim 1, wherein the creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions further comprises:

at least one of time-shifting a portion of the first speech output version of the vocal input, associating one or more speech-output-version words/sounds/marks with the first speech output version of the vocal input, segmenting the first speech output version of the vocal input in relation to at least one identifiable speech-output-version word/sound/mark, inserting one or more speech units into the first speech output version of the vocal input, redacting one or more speech units from the first speech output version of the vocal input, and re-ordering the first speech output version of the vocal input.

19. The method of claim 1, wherein the creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions further comprises:

audibly demonstrating a result of the one or more instructions.

20. The method of claim 1, wherein creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions further comprises:

creating the second speech output version of the vocal input having a substantially defined fidelity to the vocal input.

21. The method of claim 1, wherein the creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions includes;

audibly presenting the second speech output version of the vocal input having a substantially defined fidelity to the vocal input.

22. The method of claim 1, further comprising:

displaying text in response to the creating a first speech output version of the vocal input.

23. The method of claim 22, wherein the displaying text in response to the creating a first speech output version of the vocal input includes:

receiving an indication of a portion of the first speech output version of the vocal input to expand and/or contract the portion of the first speech output version, the indication via the displayed text.

24. The method of claim 22, wherein the displaying text in response to the creating a first speech output version of the vocal input includes:

processing the vocal input including inserting one or more tags into the displayed text to enable a user to edit the displayed text via an audible instruction set referential to the one or more tags.

11. (canceled)

14. (canceled)

25. A voice-capable user interface configured to manipulate a first speech output version of a vocal input, the voice-capable user interface comprising:

a set of editing tools capable of interacting with the first speech output version of the vocal input, the set of tools including one or more of a forwarding tool configured to forward to an identified location in the first speech output version of the vocal input, a reverse tool configured to reverse to an identified location in the first speech output version of the vocal input, an undo tool configured to reverse a prior action performed, a marking tool configured to mark a point in the first speech output version of the vocal input, and an expansion/contraction tool configured to expand and/or contract a predetermined length of the first speech output version of the vocal input; and

a confirmation tool configured to produce a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to use of one or more tools of the set of editing tools.

26. The voice-capable user interface of claim 25 wherein the set of editing tools is configured to operate on one or more of a mobile communication device, a voice email system, and a portable mobile device.

27. The voice-capable user interface of claim 25 wherein the set of editing tools includes a navigation tool that enables a user to identify a number of words detected in the first speech output version of the vocal input.

28. The voice-capable user interface of claim 27 wherein the navigation tool is configured to enable a user to state a number of words to step forward, and/or a number of words to step back in the first speech output version of the vocal input.

29. The voice-capable user interface of claim 27 wherein the navigation tool is configured to enable a user to state a number of words to delete, move, and/or mark in the first speech output version of the vocal input.

30. The voice-capable user interface of claim 27 wherein the navigation tool is configured to enable a user to state a key word and move a cursor to at least one location where the key word is located in the first speech output version of the vocal input.

31. The voice-capable user interface of claim 27 wherein the navigation tool is configured to enable a user to state a numerical reference in the first speech output version of the vocal input and move a cursor to at least one location where the numerical reference is located.

32. The voice-capable user interface of claim 27 wherein the navigation tool is configured to enable a user to provide a non-vocal audible command that affects the first speech output version of the vocal input.

33. (canceled)

34. A computer program product for a voice-capable system, the computer program product comprising.

a signal bearing medium bearing

one or more instructions for receiving a vocal input to the voice-capable system,

one or more instructions for receiving one or more instructions referential to the first speech output version of the vocal input, and

one or more instructions for creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions.

35. The computer program product of claim 34 wherein the signal bearing medium comprises:

a recordable medium.

36. The computer program product of claim 34 wherein the signal bearing medium comprises:

a transmission medium.

39. The computer program product of claim 34 wherein the one or more instructions for receiving a vocal input to the voice-capable system includes:

one or more instructions for processing the vocal input to enable an audible instruction set to manipulate the first speech output version of the vocal input.

40. The computer program product of claim 39 herein the one or more instructions for processing the vocal input to enable an audible instruction set to manipulate the first speech output version of the vocal input includes:

one or more instructions for enabling a user to inert with the audible instruction set, the audible instruction set including one or more commands including one or more of a skip forward command, a reverse command, a delete command, a move command, an undo command, and/or a mark command.

41. The computer program product of claim 39 wherein the one or more instructions for processing the vocal input to enable an audible instruction set to manipulate the first speech output version of the vocal input includes:

one or more instructions for enabling the user interface to navigate the first speech output version of the vocal input via one or more of the audible instruction set and/or a non-audible user interface.

42. The computer program product of claim 34 wherein the one or more instructions for receiving a vocal input to the voice capable system includes:

one or more instructions for processing the vocal input to create the first speech output version of the vocal input, the processing including inserting one or more tags into the first speech output version of the vocal input to enable a user interface.

44. The computer program product of claim 42 wherein the one or more instructions for processing the vocal input to create the first speech output version of the vocal input, the processing including inserting one or more tags into the first speech output version of the vocal input to enable a user interface includes:

one or more instructions for processing the vocal input via a voice XML-based application, the voice based application inserting the one or more tags into the first speech output version of the vocal input to enable the user interface to navigate the first speech output version of the vocal input.

45. The computer program product of claim 44 wherein the one or more instructions for processing the vocal input via a voice XML-based application, the voice XML-based application inserting the one or more tags into the first speech output version of the vocal input to enable the user interface to navigate the first speech output version of the vocal input includes:

one or more instructions for enabling the user interface to navigate the first speech output version of the vocal input via one or more of the audible instruction set and/or a non-audible user interface.

47. The computer program product of claim 34 wherein the one or more instructions for receiving one or more instructions referential to the first speech output version of the vocal input includes:

one or more instructions for receiving an instruction to identify a location in the first speech output version of the vocal input.

48. The computer program product of claim 47 wherein the one or more instruction for receiving an instruction to identify a location in the first speech output version of the vocal input includes:

one or more instructions for receiving an instruction to move forward in the first speech output version of the vocal input by a number of words/sounds/marks and/or move backward in the first speech output version of the vocal input by a number of words/sounds/marks, the voice-enabled system responding audibly and/or visually to the instruction to identify a location in the first speech output version of the vocal input.

49. The computer program product of claim 34 wherein the one or more instructions for receiving one or more instructions referential to the first speech output version of the vocal input includes:

one or more instructions for receiving an instruction to expand and/or contract a predetermined length of the first speech output version of the vocal input.

50. The computer program product of claim 49 wherein the one or more instructions for said receiving an instruction to expand and/or contract a predetermined length of the first speech output version of the vocal input includes:

one or more instructions for receiving and indication identifying the predetermined length including a starting point and time indication.

51. The computer program product of claim 50 wherein one or more instructions for said receiving an indication identifying the predetermined length including a starting point and time indication includes:

one or more instructions for receiving the indication as a tag corresponding to a navigation interface.

52. The computer program product of claim 34 wherein the one or more instructions for creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions includes:

one or more instructions for time-shifting a portion of the first speech output version of the vocal input, associating one or more speech-output-version words/sounds/marks with the first speech output version of the vocal input;

one or more instructions for segmenting the first speech output version of the vocal input in relation to at least one identifiable speech-output-version word/sound/mark;

one or more instructions for inserting one or more speech units into the first speech output version of the vocal input;

one or more instructions for time-shifting a portion of the first speech output version of the vocal input, associating one or more speech-output-version words/sounds/marks with the first speech output version of the vocal input;

one or more instructions for segmenting the first speech output version of the vocal input in relation to at least one identifiable speech-output-version word/sound/mark;

one or more instructions for inserting one or more speech units into the first speech output version of the vocal input;

one or more instructions for redacting one or more speech units from the first speech output version of the vocal input; and

one or more instructions for re-ordering the first speech output version of the vocal input.

37. (canceled)

38. (canceled)

43. (canceled)

46. (canceled)

53. (canceled)

54. (canceled)

55. (canceled)

56. (canceled)

57. The computer program product of claim 56 wherein the one or more instructions for displaying text in response to the creating a first speech output version of the vocal input includes;

one or more instructions for receiving an indication of a portion of the first speech output version of the vocal input to expand and/or contract the portion of the first speech output version, the indication via the displayed text.

58. The computer program product of claim 56 wherein the one or more instructions for displaying text in response to the creating a first speech output version of the vocal input includes:

one or more instructions for processing the vocal input including inserting one or more tags into the displayed text to enable a user to edit the displayed text via an audible instruction set referential to the one or more tags.

59. A voice-capable communication device comprising:

a processor;

an audio input and/or output circuitry coupled to the processor,

a memory coupled to the processor, and

an interface module coupled to the processor, the interface module configured to (a) receive a vocal input to the voice-capable communication device, (b) receive one or more instructions referential to a first speech output version of the vocal input; and

(c) create a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions.

60. The voice-capable communication device of claim 59 wherein the interface module is coupled to the processor, located within the processor, and/or located in the memory.

61. The voice capable communication device of claim 59 wherein the memory is one or more of random access memory, read only memory, an optical memory, or a subscriber identity module memory.

62. (canceled)

63. (canceled)