System and method for improving accuracy of signal interpretation

• US 7,826,635 B2
• Filed: 06/04/2003
• Issued: 11/02/2010
• Est. Priority Date: 12/22/2000
• Status: Expired due to Fees

• Current Assignee: Justin Santa Barbara
• Original Assignee: Justin Santa Barbara
• Inventors: Barbara, Justin Santa
• Primary Examiner(s): Le; Brian Q
• Application Number:
  US10/454,367
• Publication Number:
  US 20040101198A1
• Time in Patent Office: 2,708 Days
• Field of Search: None
• US Class Current: 382/100
• CPC Class Codes: G06V 10/987 with the intervention of an operator
• CPC Class Codes: G10L 15/32 Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems

Abstract

An interpretation system for interpreting electronic signals. The system comprising a central processor for receiving an electronic signal from a user terminal; software for (a) interpreting the signal electronically to reduce errors and (b) identifying parts of the signal that cannot be accurately interpreted electronically. In the event that there are parts of the signal that cannot be interpreted, the system is operable to present at an operator terminal the part of the signal that cannot be accurately interpreted electronically. The operator terminal is such as to allow an operator to interpret the signal and make any corrections that are deemed necessary. Once this is done, the correct interpretation is sent to the user terminal or another pre-determined electronic destination. Also provided are means for automatically adapting the electronic signal-interpretation process when operator assisted interpretation is employed, so as to extend the range of signals that can be accurately interpreted electronically. In this way, the accuracy of the system is continuously and dynamically up-dated.

Claims

1. An interpretation system comprising:

means for receiving an electronic signal via a telecommunications system from a user terminal;

processing means for interpreting the signal electronically;

means for identifying a part or parts of The signal that cannot be accurately interpreted by the processing means;

means for presenting at an operator terminal, distinct from the user terminal, the part of the signal that cannot be accurately interpreted by the processing means;

means for allowing the operator to interpret at least said part of signal,

means for sending a further signal including the interpretation of the signal to the user terminal or another pre-determined electronic destination, and

means for automatically adapting the processing means when operator assisted interpretation is employed, so that the processing means is able to interpret signals that are identified by the operator, thereby to extend the range of signals that can be accurately interpreted electronically.

3. The system of claim 1, wherein the means for interpreting the signal comprise means for cleaning up an included image to remove unwanted marks.

4. The system of claim 1, wherein the means for interpreting comprise means for identifying a block, preferably a single character, within an included image.

5. The system as claimed in claim 4, wherein means are provided for comparing the block with known blocks already stored in a library, thereby to identify the block.

6. The system as claimed in claim 4, wherein, in the event that a block cannot be identified, the means for presenting are configured to display at the operator terminal the unidentified block either alone or as part of a sequence of blocks, so that the operator is able to identify the block.

7. The system as claimed in claim 1, wherein the means for interpreting comprise means for identifying a block, preferably a single character, within an included image;

wherein, in the event that a block cannot be identified, the means for presenting are configured to display at the operator terminal the unidentified block either alone or as part of a sequence of blocks, so that the operator is able to identify the block and wherein the means for processing include a library of known blocks and means are provided for adding to the library any block that is identified by the operator, so that the library is dynamically up-dated.

8. The system of claim 1, wherein the signal includes text is derived from an electronic scanner that is operable to scan text documents and provide an electronic version of the text.

9. The system of claim 1, wherein the signal includes text captured from a keyboard located at the user terminal.

10. The system of claim 1, wherein the signal includes text is derived from voice recognition software that is operable to convert spoken words into electronic text.

11. The system as claimed in claim 10, wherein recording means are provided for receiving and including an audio version of the spoken phase in the signal.

12. The system as claimed in claim 11, wherein the operator terminal is adapted to play back at least a part of the audio recording to allow the operator to hear what was said;

thereby assisting the operator in interpretation of the signal.

13. The system of claim 1, wherein the interpretation includes a command operable to control equipment distinct from the user terminal, at the user location, such as domestic appliances.

2. A user terminal adapted for use with an interpretation system comprising:

means for receiving an electronic signal via a telecommunications system from a user terminal;

processing means for interpreting the signal electronically;

means for identifying a part or parts of the signal that cannot be accurately interpreted by the processing means;

means for presenting at an operator terminal, distinct from the user terminal, the part of the signal that cannot be accurately interpreted by the processing means;

means for allowing the operator to interpret at least said part of signal, and

means for sending a further signal including the interpretation of the signal to the user terminal or another pre-determined electronic destination.

14. A method of interpreting electronic signals comprising:

receiving the electronic signal via a telecommunications system from a user terminal;

processing the signal electronically to interpret it;

identifying parts of the signal text that cannot be accurately interpreted electronically;

presenting at an operator terminal, distinct from the user terminal, the part of the signal text that cannot be accurately interpreted electronically;

correcting errors in the presented signal interpretation by allowing human intervention,

sending a further signal including the interpretation to the user terminal or another pre-determined electronic destination, and

automatically adapting the electronic signal-interpretation process when operator assisted interpretation is employed, so as to extend the range of signals that can be accurately interpreted electronically.

15. A method as claimed in claim 14, wherein interpreting the signal involves cleaning up an included image to remove unwanted marks.

16. A method as claimed in claim 14, wherein interpreting the signal involves identifying a block, preferably a single character, within an included image.

17. A method as claimed in claim 16, comprising comparing the block with known blocks already stored in a library, thereby to identify the block.

18. A method as claimed in claim 14, wherein, in the event that a block cannot be identified, the step of presenting includes displaying at the operator terminal the unidentified block either alone or as part of a sequence of blocks, so that the operator is able to identify the block.

19. A method as claimed in claim 18, comprising adding to the library of known blocks any block that is identified by the operator, so that the library is dynamically up-dated.

20. A method as claimed in claim 14, wherein the signal includes text derived from an electronic scanner that is operable to scan documents and provide an electronic version of the text.

21. A method as claimed in claim 14, wherein the signal includes text captured from a keyboard located at the user terminal.

22. A method as claimed in claim 14, wherein the signal includes text derived from voice recognition software that is operable to convert spoken words into electronic text.

23. A method as claimed in claim 14, wherein the signal includes an audio version of the spoken phrase.

24. A method as claimed in claim 23, comprising playing back at least a part of the audio recording to allow the operator to hear what was said, thereby assisting the operator in interpretation of the signal.

25. A method as claimed in claim 14, wherein the interpretation includes a command operable to control equipment distinct from the user terminal, at the user location, such as domestic appliances.

26. A computer program, on a computer readable medium, for controlling a method of interpreting electronic signals, the computer program comprising instructions for:

receiving the electronic signal via a telecommunications system from a user terminal;

processing the signal electronically to interpret it;

identifying parts of the signal that cannot be accurately interpreted electronically;

presenting at an operator terminal the part of the signal that cannot be accurately interpreted electronically;

correcting errors in the text presented signal interpretation by allowing human intervention;

sending a further signal including the interpretation to the user terminal or another pre-determined electronic destination, and

automatically adapting the electronic signal-interpretation process when operator assisted interpretation is employed, so as to extend the range of signals that can be accurately interpreted electronically.

27. A method of interpreting electronic signals consisting of natural language text or signals derived from voice interface equipment operable to convert spoken words into electronic format comprising:

receiving electronic signals via a telecommunications systems from at least one user terminal;

electronically processing the signals to interpret them with respect to the user'"'"'s intent;

identifying at least one part of the signals that cannot be accurately interpreted electronically;

presenting at an operator terminal, distinct from the user terminal, the said at least one part for human operator interpretation;

receiving a corrected interpretation of the presented part as a result of said human operator interpretation;

sending signals comprising at least the corrected interpretation to the originating user terminal or another predetermined electronic destination, distinct from the operator terminal, and

automatically adapting said electronic signal-interpretation processing in response to said operator intervention so as to extend the range of signals that can be accurately interpreted electronically.

28. A method as claimed in claim 27, wherein the step of electronically processing involves identifying a phrase or sub-phrase and comparing the phrase or sub-phrase with known phrases or sub-phrases already stored in a knowledge base thereby to interpret the phrase or sub-phrase.

29. A method as claimed in claim 28, wherein, in the event that a phrase or sub-phrase cannot be interpreted, the step of processing includes presenting at the operator terminal said phrase or sub-phrase either alone or as part of a sequence of phrases or sub-phrases, so that the operator is able to interpret the phrase or sub-phrase.

30. A method as claimed in claim 29, comprising adding to the library of known phrases or sub-phases any phrase or sub-phrase that is identified by the operator, so that the knowledge base is dynamically updated.

31. A method as claimed in claim 27, wherein the signals include an audio version of a spoken phrase.

32. A method according to claim 27, wherein the telecommunications system comprises at least one of a communication network and the Internet, and/or wherein the sending step comprises sending the corrected interpretation of each said at least one part together with the parts of the signal that can be accurately interpreted electronically.

33. A computer program on a computer readable medium, the computer program comprising instructions for interpreting electronic signals using the method according to claim 27.