Computer-implemented system and method for correlating activity within a user interface with special information

• US 9,953,147 B2
• Filed: 05/19/2014
• Issued: 04/24/2018
• Est. Priority Date: 06/28/2006
• Status: Active Grant

• Current Assignee: Avaya LLC (Avaya Incorporated), Avaya Management L.P. (Avaya Incorporated)
• Original Assignee: Intellisist, Inc. dba Spoken Communications (Avaya Incorporated)
• Inventors: Doren, G. Kevin
• Primary Examiner(s): Serrou, Abdelali
• Application Number:
  US14/281,842
• Publication Number:
  US 20140331331A1
• Time in Patent Office: 1,436 Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/6263 during internet communication, e.g. revealing personal data from cookies
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 21/00 Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: H04M 3/42221 Conversation recording systems at the subscriber's set H04M1/656

Abstract

A computer-implemented system and method for correlating activity within a user interface with special information is provided. A user interface with data entry fields is provided. One or more of the data entry fields is designated for special information. A first screen shot of the user interface is captured, and a second screen shot of the user interface is captured at a later time. The first and second screen shots are compared. A change comprising at least a portion of an entry within one of the data entry fields for special information in the second screen shot is identified between the first and second screen shots. The entry is rendered unintelligible.

Claims

1. A computer-implemented system for correlating activity within a user interface with special information, comprising:

a voice recording comprising special information; and

a processor to;

provide data entry fields within a user interface, wherein one or more of the data entry fields is designated for the special information;

obtain a first image of at least a portion of the user interface with at least one of the data entry fields designated for special information at an initial time;

obtain a second image of the same portion of the user interface at a later time;

compare the first and second images;

determine based on the comparison, data in the second image in the data entry field designated for special information, not present in the first image, wherein the data in the second image is identified as special information and correlated with at least a portion of the special information in the voice recording;

automatically render the data in the data entry field designated for special information unintelligible upon identification of the data; and

render the correlated special information in the voice recording unintelligible.

2. A system according to claim 1, wherein the processor records a time of the entry of the special information.

3. A system according to claim 1, wherein the special information is received via one of a stylus, mouse, keyboard, and voice activation.

4. A system according to claim 1, wherein the processor monitors a call associated with the voice recording and receives the data in response to a request for information during the call.

5. A system according to claim 1, wherein the processor records the call and marks at least one of a beginning and an end of the special information in the voice recording.

6. A system according to claim 1, wherein the processor records the call and marks at least one of a beginning and an end of the special information in the voice recording.

7. A system according to claim 1, wherein the processor transfers the voice recording with unintelligible special information to a third party.

8. A system according to claim 1, wherein rendering of the special information comprises one of encrypting the special information, masking the special information, and deleting the special information.

9. A system according to claim 1, wherein the special information comprises information to which access is limited.

10. A computer-implemented method for correlating activity within a user interface with special information, comprising:

obtaining a voice recording comprising special information;

providing a user interface with data entry fields, wherein one or more of the data entry fields is designated for the special information;

at an initial time, obtaining a first image of at least a portion of the user interface with at least one of the data entry fields designated for special information;

at a later time, obtaining a second image of the same portion of the user interface;

comparing the first and second images;

determining based on the comparison, data in the second image in the data entry field designated for special information, not present in the first image, wherein the data in the second image is identified as special information and correlated with at least a portion of the special information in the voice recording;

automatically rendering the data in the data entry field designated for special information unintelligible upon identification of the data; and

render the correlated special information in the voice recording unintelligible, wherein the steps are performed by a processor.

11. A method according to claim 10, further comprising:

recording a time of the entry of the special information.

12. A method according to claim 10, further comprising:

receiving the special information via one of a stylus, mouse, keyboard, and voice activation.

13. A method according to claim 10, further comprising:

monitoring a call associated with the voice recording; and

receiving the data in response to a request for information during the call.

14. A method according to claim 10, further comprising:

marking at least one of a beginning and an end of the special information in the voice recording.

15. A method according to claim 14, further comprising

utilizing the markers to identify at least one of a beginning and end of the special information in the voice recording.

16. A method according to claim 10, further comprising:

transferring the voice recording with the unintelligible special information to a third party.

17. A method according to claim 10, wherein rendering of the special information comprises one of encrypting the special information, masking the special information, and deleting the special information.

18. A method according to claim 10, wherein the special information comprises information to which access is limited.