Voice controllable interactive communication display system and method

• US 9,240,179 B2
• Filed: 08/05/2005
• Issued: 01/19/2016
• Est. Priority Date: 08/05/2005
• Status: Expired due to Fees

• Current Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Original Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Inventors: Jung, Edward K. Y., Levien, Royce A., Lord, Robert W., Malamud, Mark A., Rinaldo, John D. Jr.
• Primary Examiner(s): Chawan, Vijay B
• Application Number:
  US11/198,904
• Publication Number:
  US 20070033047A1
• Time in Patent Office: 3,819 Days
• Field of Search: 704/200, 704/261, 704/270, 704/275, 704/270.1, 704/219, 704/220, 704/258, 704/254, 704/274, 704/218, 381/94.1, 381/110
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06F 40/14 Tree-structured documents parsing G06F40/205; validation G06F40/226
• CPC Class Codes: G06F 40/177 of tables; using ruled lines
• CPC Class Codes: G10L 13/033 Voice editing, e.g. manipulating the voice of the synthesiser
• CPC Class Codes: G10L 13/047 Architecture of speech synthesisers
• CPC Class Codes: G10L 15/142 Hidden Markov Models [HMMs]
• CPC Class Codes: G10L 15/18 using natural language modelling
• CPC Class Codes: G10L 15/222 Barge in, i.e. overridable guidance for interrupting prompts
• CPC Class Codes: G10L 19/24 Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
• CPC Class Codes: H04M 1/271 controlled by voice recognition

Abstract

A system and method for use with a voice-capable system, includes but is not limited to receiving a vocal input to the voice-capable system, receiving one or more instructions referential to the first speech output version of the vocal input, and creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions.

Claims

1. A method for a voice-capable system, the method comprising:

receiving a vocal input to the voice-capable system;

processing the vocal input to create a first speech output version of the vocal input, the processing including at least;

determining one or more destination systems for the first speech output version of the vocal input;

altering a sample rate of the vocal input to enable the vocal input to interact with the one or more destination systems;

and

receiving one or more non-vocal audible instructions referential to the first speech output version of the vocal input; and

creating a second speech output version of the vocal input, the second output version being the first speech output version of the vocal input content manipulated responsive to the one or more non-vocal audible instructions.

2. The method of claim 1, wherein the processing the vocal input to create a first speech output version of the vocal input includes at least one of:

creating a speech representation having a substantially defined fidelity to the vocal input, or audibly presenting a speech representation having a substantially defined fidelity to the vocal input.

3. The method of claim 1, wherein the processing the vocal input to create a first speech output version of the vocal input includes at least one of:

enabling a user to interact with an audible instruction set configured to manipulate the first speech output version of the vocal input, the audible instruction set including one or more commands including one or more of a skip forward command, a reverse command, a delete command, a move command, an undo command, and/or a mark command, or enabling a user interface to navigate the first speech output version of the vocal input via a non-vocal audible instruction set.

4. The method of claim 1 further comprising:

inserting one or more tags into the first speech output version of the vocal input to enable a user interface to navigate the first speech output version of the vocal input via a non-vocal audible instruction set.

5. The method of claim 4, wherein inserting one or more tags into the first speech output version of the vocal input to enable a user interface to navigate the first speech output version of the vocal input via a non-vocal audible instruction set-includes:

creating a table of the one or more tags, the table enabling at least a non-vocal audible instruction set.

6. The method of claim 1, wherein the processing the vocal input to create the first speech output version of the vocal input includes:

inserting one or more tags into the first speech output version of the vocal input to enable a user interface; and

processing the vocal input via a voice XML-based application, the voice XML-based application inserting one or more time-delineated tags into the speech representation of the vocal input to create the first speech output version, each tag configured to be referenced by providing a time value.

7. The method of claim 6, wherein processing the vocal input via a voice XML-based application, the voice XML-based application inserting one or more time-delineated tags into the speech representation of the vocal input to create the first speech output version, each tag configured to be referenced by providing a time value includes:

enabling a user interface to navigate the first speech output version of the vocal input via one or more of an audible instruction set and/or a non-audible user interface.

8. The method of claim 1, wherein the receiving one or more non-vocal audible instructions referential to the first speech output version of the vocal input includes:

receiving a non-vocal audible instruction to identify a number of words to move to a different location in the first speech output version of the vocal input.

9. The method of claim 8, wherein the receiving a non-vocal audible instruction to identify a location in the first speech output version of the vocal input includes:

receiving a non-vocal audible instruction to move forward in the first speech output version of the vocal input by a number of words and/or sounds and/or marks and/or move backward in the first speech output version of the vocal input by a number of words and/or sounds and/or marks, the voice-enabled system responding audibly and/or visually to the non-vocal audible instruction to identify a location in the first speech output version of the vocal input.

10. The method of claim 1, wherein the receiving one or more non-vocal audible instructions referential to the first speech output version of the vocal input includes:

receiving a non-vocal audible instruction to expand and/or contract a predetermined length of the first speech output version of the vocal input.

11. The method of claim 10, wherein receiving a non-vocal audible instruction to expand and/or contract a predetermined length of the first speech output version of the vocal input includes:

receiving a non-vocal audible indication identifying the predetermined length including a starting point and time indication.

12. The method of claim 11, wherein the receiving a non-vocal audible indication identifying the predetermined length including a starting point and time indication includes:

receiving the time indication as a tag corresponding to a navigation interface.

13. The method of claim 1, wherein the creating a second speech output version of the vocal input, the second output version being the first speech output version of the vocal input content manipulated responsive to the one or more audible instructions, comprises:

re-ordering the first speech output version of the vocal input responsive to the one or more non-vocal audible instructions.

14. The method of claim 1, wherein the creating a second speech output version of the vocal input, the second output version being the first speech output version of the vocal input content manipulated responsive to the one or more non-vocal audible instructions, comprises:

audibly demonstrating a result of the one or more non-vocal audible instructions.

15. The method of claim 1, wherein the creating a second speech output version of the vocal input, the second output version being the first speech output version of the vocal input content manipulated responsive to the one or more non-vocal audible instructions, comprises:

creating the second speech output version of the vocal input having a substantially defined fidelity to the vocal input.

16. The method of claim 1, wherein the creating a second speech output version of the vocal input, the second output version being the first speech output version of the vocal input content manipulated responsive to the one or more non-vocal audible instructions, includes:

audibly presenting the second speech output version of the vocal input having a substantially defined fidelity to the vocal input.

17. The method of claim 1, further comprising:

displaying text in response to the creating a first speech output version of the vocal input.

18. The method of claim 17, wherein the displaying text in response to the creating a first speech output version of the vocal input includes:

receiving an indication of a portion of the first speech output version of the vocal input to expand and/or contract the portion of the first speech output version, the indication via the displayed text.

19. The method of claim 17, wherein the displaying text in response to the creating a first speech output version of the vocal input includes:

processing the vocal input including inserting one or more tags into the displayed text to enable a user to edit the displayed text via an audible instruction set referential to the one or more tags.

20. The method of claim 1, wherein determining one or more destination systems for the first speech output version of the vocal input includes:

determining the one or more destination systems for the first speech output version of the vocal input, the one or more destination systems being at least one or more systems along a path to a final destination system for the first speech output version of the vocal input.

21. The method of claim 1, wherein processing the vocal input to create a first speech output version of the vocal input, the processing further including:

formatting the vocal input to computer code.

22. An article of manufacture comprising a voice-capable user interface module stored in a computer storage medium configured to manipulate a first speech output version of a vocal input, the voice-capable user interface comprising:

a set of editing tools capable of enabling verbal interaction with the first speech output version of the vocal input, the vocal input processed to create the first speech output version via determining one or more destination systems for the first speech output version of the vocal input and altering a sample rate of the vocal input to enable the vocal input to interact with the one or more destination systems, the set of editing tools including at least a navigation tool that enables a user to identify a number of words to move to a different location in the first speech output version of the vocal input; and

a confirmation tool configured to produce a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to use of one or more tools of the set of editing tools.

23. The voice-capable user interface module of claim 22 wherein the set of editing tools is configured to operate on one or more of a mobile communication device, a voice email system, or a portable mobile device.

24. The voice-capable user interface module of claim 22 wherein the set of editing tools includes one or more of a forwarding tool configured to forward to an identified location in the first speech output version of the vocal input, a reverse tool configured to reverse to an identified location in the first speech output version of the vocal input, an undo tool configured to reverse a prior action performed, a marking tool configured to mark a point in the first speech output version of the vocal input, or an expansion/contraction tool configured to expand and/or contract a predetermined length of the first speech output version of the vocal input.

25. The voice-capable user interface module of claim 22 wherein the navigation tool is configured to enable a user to state a number of words to step forward, and/or a number of words to step back in the first speech output version of the vocal input.

26. The voice-capable user interface module of claim 22 wherein the navigation tool is configured to enable a user to state a number of words to at least one of delete or mark in the first speech output version of the vocal input.

27. The voice-capable user interface module of claim 22 wherein the navigation tool is configured to enable a user to provide a non-vocal audible command to perform one or more operations of the navigation tool.

28. The voice-capable user interface module of claim 22 wherein the navigation tool is configured to enable a user to state a numerical reference in the first speech output version of the vocal input and move a cursor to at least one location where the numerical reference is located.

29. The voice-capable user interface module of claim 22 wherein the set of editing tools includes at least one tool configured to enable a user to provide a non-vocal audible command that affects the first speech output version of the vocal input.

30. A computer program product including one or more instructions for a voice-capable system, the computer program product comprising:

a non-transitory signal bearing medium bearing at least;

one or more instructions for receiving a vocal input to the voice-capable system,

one or more instructions for processing the vocal input to create a first speech output version of the vocal input, the one or more instructions for processing including at least;

one or more instructions for creating a speech representation of the vocal input with an adjustable fidelity;

one or more instructions for determining one or more destination systems for the first speech output version of the vocal input;

one or more instructions for altering a sample rate of the vocal input to enable the vocal input to interact with the one or more destination systems;

one or more instructions for receiving one or more audible instructions referential to the first speech output version of the vocal input; and

one or more instructions for re-ordering the first speech output version of the vocal input responsive to the one or more audible instructions; and

one or more instructions for creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions.

31. The computer program product of claim 30 wherein the signal bearing medium comprises:

a recordable medium.

32. The computer program product of claim 30 wherein the one or more instructions for receiving a vocal input to the voice-capable system includes:

one or more instructions for processing the vocal input to enable an audible instruction set to manipulate the first speech output version of the vocal input.

33. The computer program product of claim 32 wherein the one or more instructions for processing the vocal input to enable an audible instruction set to manipulate the first speech output version of the vocal input includes:

one or more instructions for enabling a user to interact with the audible instruction set, the audible instruction set including one or more commands including one or more of a skip forward command, a reverse command, a delete command, a move command, an undo command, and/or a mark command.

34. The computer program product of claim 32 wherein the one or more instructions for processing the vocal input to enable an audible instruction set to manipulate the first speech output version of the vocal input includes:

one or more instructions for enabling the user interface to navigate the first speech output version of the vocal input via one or more of the audible instruction set and/or a non-audible user interface.

35. The computer program product of claim 30 wherein the one or more instructions for receiving a vocal input to the voice-capable system includes:

one or more instructions for processing the vocal input to create the first speech output version of the vocal input, the processing including inserting one or more tags into the first speech output version of the vocal input to enable a user interface.

36. The computer program product of claim 35 wherein the one or more instructions for processing the vocal input to create the first speech output version of the vocal input, the processing including inserting one or more tags into the first speech output version of the vocal input to enable a user interface includes:

one or more instructions for processing the vocal input via a voice XML-based application, the voice XML-based application inserting the one or more tags into the first speech output version of the vocal input to enable the user interface to navigate the first speech output version of the vocal input.

37. The computer program product of claim 36 wherein the one or more instructions for processing the vocal input via a voice XML-based application, the voice XML-based application inserting the one or more tags into the first speech output version of the vocal input to enable the user interface to navigate the first speech output version of the vocal input includes:

one or more instructions for enabling the user interface to navigate the first speech output version of the vocal input via one or more of the audible instruction set and/or a non-audible user interface.

38. The computer program product of claim 30 wherein the one or more instructions for receiving one or more instructions referential to the first speech output version of the vocal input includes:

one or more instructions for receiving an instruction to identify a location in the first speech output version of the vocal input.

39. The computer program product of claim 38 wherein the one or more instructions for receiving an instruction to identify a location in the first speech output version of the vocal input includes:

one or more instructions for receiving an instruction to move forward in the first speech output version of the vocal input by a number of words and/or sounds and/or marks and/or move backward in the first speech output version of the vocal input by a number of words and/or sounds and/or marks, the voice-enabled system responding audibly and/or visually to the instruction to identify a location in the first speech output version of the vocal input.

40. The computer program product of claim 30 wherein the one or more instructions for receiving one or more instructions referential to the first speech output version of the vocal input includes:

one or more instructions for receiving an instruction to expand and/or contract a predetermined length of the first speech output version of the vocal input.

41. The computer program product of claim 40 wherein the one or more instructions for said receiving an instruction to expand and/or contract a predetermined length of the first speech output version of the vocal input includes:

one or more instructions for receiving an indication identifying the predetermined length including a starting point and time indication.

42. The computer program product of claim 30 wherein one or more instructions for processing the vocal input to create a first speech output version of the vocal input includes:

one or more instructions for identifying a number of words to move to a different location in the first speech output version of the vocal input.

43. The computer program product of claim 30 wherein the one or more instructions for creating a second speech output version of the vocal input representational of the first speech output version of the vocal input manipulated responsive to the one or more instructions includes:

one or more instructions for time-shifting a portion of the first speech output version of the vocal input, associating one or more speech-output-version words and/or sounds and/or marks with the first speech output version of the vocal input;

one or more instructions for segmenting the first speech output version of the vocal input in relation to at least one identifiable speech-output-version word and/or sound and/or mark;

one or more instructions for inserting one or more speech units into the first speech output version of the vocal input;

one or more instructions for redacting one or more speech units from the first speech output version of the vocal input; and

one or more instructions for re-ordering the first speech output version of the vocal input.

44. The computer program product of claim 30 further comprising:

one or more instructions for displaying text in response to the creating a first speech output version of the vocal input.

45. The computer program product of claim 30 further comprising:

one or more instructions for displaying text in response to the creating a first speech output version of the vocal input including;

one or more instructions for receiving an indication of a portion of the first speech output version of the vocal input to expand and/or contract the portion of the first speech output version, the indication via the displayed text.

46. The computer program product of claim 45 wherein the one or more instructions for displaying text in response to the creating a first speech output version of the vocal input includes:

one or more instructions for processing the vocal input including inserting one or more tags into the displayed text to enable a user to edit the displayed text via an audible instruction set referential to the one or more tags.

47. A voice-capable communication device comprising:

a processor;

an audio input and/or output circuitry coupled to the processor;

a memory coupled to the processor; and

an interface module coupled to the processor, the interface module configured to (a) receive a vocal input to the voice-capable communication device, (b) process the vocal input to create a first speech output version of the vocal input via determining one or more destination systems for the first speech output version of the vocal input and altering a sample rate of the vocal input to enable the vocal input to interact with the one or more destination systems, (c) receive one or more non-vocal audio instructions referential to the first speech output version of the vocal input; and

(d) create a second speech output version of the vocal input of the first speech output version of the vocal input content manipulated responsive to the one or more non-vocal audio instructions.

48. The voice-capable communication device of claim 47 wherein the interface module is coupled to the processor, located within the processor, and/or located in the memory.

49. The voice capable communication device of claim 47 wherein the memory is one or more of random access memory, read only memory, an optical memory, or a subscriber identity module memory.

50. A method for a voice-capable system, the method comprising:

receiving a vocal input to the voice-capable system;

processing the vocal input to create a textual first speech output version of the vocal input by;

(a) creating a visible textual speech representation of the vocal input;

(b) determining one or more destination systems for the first speech output version of the vocal input and altering a sample rate of the vocal input to enable the vocal input to interact with the one or more destination systems; and

(c) enabling a user to identify a number of words to move to a different location in the first speech output version of the vocal input; and

receiving one or more instructions referential to the visible textual first speech output version of the vocal input to enable audible instruction manipulation of identified visible textual content; and

creating a second speech output version of the vocal input, the second output version being the first speech output version of the vocal input content manipulated responsive to the one or more instructions.