METHODS AND APPARATUS FOR PROOFING OF A TEXT INPUT

• US 20120310643A1
• Filed: 05/23/2012
• Published: 12/06/2012
• Est. Priority Date: 05/23/2011
• Status: Active Grant

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Labsky, Martin, Kleindienst, Jan, Macek, Tomas, Nahamoo, David, Curin, Jan, Koenig, Lars, Quast, Holger
• Granted Patent: US 9,236,045 B2
• Time in Patent Office: Days
• US Class Current: 704/235
• CPC Class Codes: G06F 40/10 Text processing natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/01 Assessment or evaluation of speech recognition systems
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit
• CPC Class Codes: G10L 15/06 Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice G10L15/14 takes precedence
• CPC Class Codes: G10L 15/14 using statistical models, e.g. Hidden Markov Models [HMMs] G10L15/18 takes precedence
• CPC Class Codes: G10L 15/1822 Parsing for meaning understanding
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 15/28 Constructional details of speech recognition systems
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 15/32 Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence

Abstract

Techniques for presenting data input as a plurality of data chunks including a first data chunk and a second data chunk. The techniques include converting the plurality of data chunks to a textual representation comprising a plurality of text chunks including a first text chunk corresponding to the first data chunk and a second text chunk corresponding to the second data chunk, respectively, and providing a presentation of at least part of the textual representation such that the first text chunk is presented differently than the second text chunk to, when presented, assist a user in proofing the textual representation.

Claims

1. A method for presenting data input as a plurality of data chunks including a first data chunk and a second data chunk, the method comprising:

converting the plurality of data chunks to a textual representation comprising a plurality of text chunks including a first text chunk corresponding to the first data chunk and a second text chunk corresponding to the second data chunk, respectively; and

providing a presentation of at least part of the textual representation such that the first text chunk is presented differently than the second text chunk to, when presented, assist a user in proofing the textual representation.

2. The method of claim 1, wherein the data input by the user includes speech and wherein converting the plurality of data chunks includes performing automatic speech recognition on the plurality of data chunks to convert the plurality of data chunks into the textual representation.

3. The method of claim 1, wherein providing the presentation includes providing a visual presentation and/or an audio presentation of at least part of the textual representation.

4. The method of claim 3, further comprising designating one of the plurality of text chunks as an active chunk and highlighting the active chunk in the presentation.

5. The method of claim 4, further comprising:

designating another of the plurality of text chunks as the active chunk in response to user input indicating that the user would like to select a different one of the plurality of text chunks to be the active chunk; and

modifying the presentation to highlight the newly designated active chunk.

6. The method of claim 4, further comprising deleting at least a portion of the active chunk from the textual representation in response to receiving user input to delete the at least a portion of the active chunk.

7. The method of claim 4, further comprising replacing at least a portion of the active chunk with different text converted from further data input from the user in response to receiving user input to replace at least a portion of the active chunk.

8. The method of claim 4, wherein the presentation includes a visual presentation of each of the plurality of text chunks wherein the active chunk is highlighted and at least one other of the plurality of text chunks is presented differently than at least an additional one of the plurality of text chunks.

9. The method of claim 8, further comprising visually rendering the visual presentation to the user via a display.

10. The method of claim 4, wherein the presentation includes an audio presentation formed, at least in part, by generating an audio signal corresponding to at least the active chunk by using text-to-speech synthesis (TTS).

11. The method of claim 10, further comprising audibly rendering the audio presentation to the user via at least one speaker.

12. The method of claim 4, wherein the textual representation is formed, at least in part, of a plurality of words, the method further comprising:

designating one of the plurality of words as an active word in response to a user selecting a word mode;

designating another of the plurality of words as the active word in response to user input indicating that the user would like to select a different one of the plurality of words to be the active word; and

modifying the presentation to highlight the newly designated active word.

13. The method of claim 4, wherein the textual representation is formed, at least in part, of a plurality of characters, the method further comprising:

designating one of the plurality of characters as an active character in response to a user selecting a character mode;

designating another of the plurality of characters as the active character in response to user input indicating that the user would like to select a different one of the plurality of characters to be the active character; and

modifying the presentation to highlight the newly designated active character.

14. A system for presenting data input as a plurality of data chunks including a first data chunk and a second data chunk, the system comprising:

at least one input for receiving data from the user as a plurality of data chunks including a first data chunk and a second data chunk;

a conversion component configured to convert the plurality of data chunks to a textual representation to provide a plurality of text chunks including a first text chunk corresponding to the first data chunk and a second text chunk corresponding to the second data chunk, respectively; and

a presentation component configured to provide a presentation of at least part of the textual representation such that the first text chunk is presented differently than the second text chunk to, when presented, assist the user in proofing the textual representation.

16. The system of claim 14, wherein the presentation component includes a visual presentation component configured to generate a visual presentation and/or an audio presentation component configured to generate an audio presentation of at least part of the textual representation.

17. The system of claim 16, wherein the presentation component designates at least one of the plurality of text chunks as an active chunk and highlights the active chunk in the presentation.

18. The system of claim 16, wherein the presentation component is configured to designate another of the plurality of text chunks as the active chunk in response to user input indicating that the user would like to select a different one of the plurality of text chunks to be the active chunk, and modifying the presentation to highlight the newly designated active chunk.

19. The system of claim 16, wherein the presentation component is configured to remove at least a portion of the active chunk from the textual representation in response to receiving, at the at least one input, indication from the user to delete the at least a portion of the active chunk.

20. The system of claim 16, wherein the presentation component is configured to replace at least a portion of the active chunk in response to receiving user input to replace at least a portion of the active chunk with different text converted from further data input from the user received at the least one input.

21. The system of claim 16, wherein the presentation component is configured to generate a visual presentation of each of the plurality of text chunks wherein the active chunk is highlighted and at least one other of the plurality of text chunks is presented differently than other of the plurality of text chunks.

22. The system of claim 21, further comprising at least one display coupled to the presentation component to display the visual presentation to the user.

23. The system of claim 16, wherein the presentation component is configured to generate an audio presentation by forming an audio signal of at least the active chunk using text-to-speech synthesis (TTS) on at least the active chunk.

24. The system of claim 23, further comprising at least one speaker coupled to the presentation component to render the audio signal audibly to the user.

25. The system of claim 16, wherein the textual representation is formed, at least in part, of a plurality of words, and wherein the presentation component is configured to designate one of the plurality of words as an active word in response to a user selecting a word mode, designate another of the plurality of words as the active word in response to user input indicating that the user would like to select a different one of the plurality of words to be the active word, and modify the presentation to highlight the newly designated active word.

26. The system of claim 16, wherein the textual representation is formed, at least in part, of a plurality of characters, and wherein the presentation component is configured to designate one of the plurality of characters as an active character in response to a user selecting a character mode, designate another of the plurality of characters as the active character in response to user input indicating that the user would like to select a different one of the plurality of characters to be the active character, and modify the presentation to highlight the newly designated active character to the user.

15. The system of claim 15, wherein the data input by the user includes speech and the conversion component includes at least one automatic speech recognition (ASR) engine configure to convert the plurality of data chunks includes performing automatic speech recognition on the plurality of data chunks to convert the plurality of data chunks into the textual representation.

27. At least one computer readable medium storing instructions that, when executed on at least one computer, perform method for presenting data input as a plurality of data chunks including a first data chunk and a second data chunk, the method comprising:

converting the plurality of data chunks to a textual representation comprising a plurality of text chunks including a first text chunk corresponding to the first data chunk and a second text chunk corresponding to the second data chunk, respectively; and

providing a presentation of at least part of the textual representation such that the first text chunk is presented differently than the second text chunk to, when presented, assist a user in proofing the textual representation.

28. The at least one computer readable medium of claim 27, wherein the data input by the user includes speech and wherein converting the plurality of data chunks includes performing automatic speech recognition on the plurality of data chunks to convert the plurality of data chunks into the textual representation.

29. The at least one computer readable medium of claim 27, wherein providing the presentation includes providing a visual presentation and/or an audio presentation of at least part of the textual representation.

30. The at least one computer readable medium of claim 29, further comprising designating one of the plurality of text chunks as an active chunk and highlighting the active chunk in the presentation.

31. The at least one computer readable medium of claim 30, further comprising:

designating another of the plurality of text chunks as the active chunk in response to user input indicating that the user would like to select a different one of the plurality of text chunks to be the active chunk; and

modifying the presentation to highlight the newly designated active chunk.

32. The at least one computer readable medium of claim 30, further comprising deleting at least a portion of the active chunk from the textual representation in response to receiving user input to delete the at least a portion of the active chunk.

33. The at least one computer readable medium of claim 30, further comprising replacing at least a portion of the active chunk with different text converted from further data input from the user in response to receiving user input to replace at least a portion of the active chunk.

34. The at least one computer readable medium of claim 30, wherein the presentation includes a visual presentation of each of the plurality of text chunks wherein the active chunk is highlighted and at least one other of the plurality of text chunks is presented differently than at least an additional one of the plurality of text chunks.

35. The at least one computer readable medium of claim 34, further comprising visually rendering the visual presentation to the user via a display.

36. The at least one computer readable medium of claim 30, wherein the presentation includes an audio presentation formed, at least in part, by generating an audio signal corresponding to at least the active chunk by using text-to-speech synthesis (TTS).

37. The at least one computer readable medium of claim 36, further comprising audibly rendering the audio presentation to the user via at least one speaker.

38. The at least one computer readable medium of claim 30, wherein the textual representation is formed, at least in part, of a plurality of words, the method further comprising:

designating one of the plurality of words as an active word in response to a user selecting a word mode;

designating another of the plurality of words as the active word in response to user input indicating that the user would like to select a different one of the plurality of words to be the active word; and

modifying the presentation to highlight the newly designated active word.

39. The at least one computer readable medium of claim 30, wherein the textual representation is formed, at least in part, of a plurality of characters, the method further comprising:

designating one of the plurality of characters as an active character in response to a user selecting a character mode;

designating another of the plurality of characters as the active character in response to user input indicating that the user would like to select a different one of the plurality of characters to be the active character; and

modifying the presentation to highlight the newly designated active character.