Detection of deceptive indicia masking in a communications interaction

• US 9,026,678 B2
• Filed: 12/30/2011
• Issued: 05/05/2015
• Est. Priority Date: 11/30/2011
• Status: Active Grant

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Tegreene, Clarence T., Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A.
• Primary Examiner(s): Wasel, Mohamed
• Assistant Examiner(s): WU, TSUNG YIN
• Application Number:
  US13/374,516
• Publication Number:
  US 20130139255A1
• Time in Patent Office: 1,222 Days
• Field of Search: 726 22- 34, 600300-308, 382/118, 704/9, 704/270, 709/246
• US Class Current: 709/246
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/164 Lie detection
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

Systems, methods, computer-readable storage mediums including computer-readable instructions and/or circuitry for detecting masking of deceptive indicia in communications content may implement operations including, but not limited to: receiving one or more signals associated with communications content provided by a first participant in a communications interaction; and detecting at least one indicia of a modification of the communications content associated with at least one indicia of deception by the first participant.

Claims

1. A system comprising:

at least one computing device; and

one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for;

receiving audio and/or video data representing a participant in at least one of an audio or audio/video conferencing interaction with at least one other participant;

detecting at least one indicia of a prior modification of the audio and/or video data representing the participant;

determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant; and

providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant.

2. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of one or more pixels of a video frame of the video data representing the participant.

3. The system of claim 2, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior replacement of one or more video frames of the video data representing the participant.

4. The system of claim 2, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior reduction in a resolution of the video data representing the participant.

5. The system of claim 2, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior reduction in a frame rate of the video data representing the participant.

6. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of an audio characteristic of the audio data representing the participant.

7. The system of claim 6, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior replacement of one or more portions of the audio data representing the participant.

8. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of an eye dilation of the participant in the video data representing the participant.

9. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of an eye movement of the participant in the video data representing the participant.

10. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of a heart rate of the participant in the audio and/or video data representing the participant.

11. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of a blood pressure of the participant in the audio and/or video data representing the participant.

12. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of a perspiration level of the participant in the video data representing the participant.

13. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of a breathing rate of the participant in the audio and/or video data representing the participant.

14. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of video data representing one or more micro expressions of the participant.

15. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of audio data representing voice stress of the participant.

16. The system of claim 1, wherein the detecting at least one indicia of a prior modification of the audio and/or video data representing the participant includes:

detecting at least one indicia of a prior modification of audio data representing characteristic language of the participant.

17. The system of claim 1, wherein the providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant includes:

displaying, within a field of view of the at least one other participant, a visual indicator indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant that masks at least one indicia of deception by the participant.

18. The system of claim 17, wherein the displaying, within a field of view of the at least one other participant, a visual indicator indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant that masks at least one indicia of deception by the participant includes:

displaying a visual indicator indicative of a number of occurrences of detected indicia of a prior modification of the audio and/or video data representing the participant.

19. The system of claim 17, wherein the displaying, within a field of view of the at least one other participant, a visual indicator indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant that masks at least one indicia of deception by the participant includes:

displaying a visual indicator indicative of a rate of occurrences of detected indicia of a prior modification of the audio and/or video data representing the participant.

20. The system of claim 17, wherein the displaying, within a field of view of the at least one other participant, a visual indicator indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant that masks at least one indicia of deception by the participant includes:

displaying a color coded visual indicator indicative of one or more detected indicia of a prior modification of the prior modification of the audio and/or video data representing the participant.

21. The system of claim 1, wherein the providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant includes:

emitting an audible notification, to the at least one other participant, that is indicative of at least one detected indicia of a prior modification of the audio and/or video data representing the participant.

22. The system of claim 1, wherein the providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant includes:

providing a notification, to the at least one other participant, that is indicative of at least one detected indicia of a prior modification of the audio and/or video data representing the participant to the at least one other participant during the at least one of an audio or audio/video conferencing interaction with at least one other participant.

23. The system of claim 1, wherein the providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant includes:

providing a notification indicative of at least one detected indicia of a prior modification of the audio and/or video data representing the participant to the at least one other participant following the at least one of an audio or audio/video conferencing interaction with at least one other participant.

24. The system of claim 1, further comprising one or more instructions that, when implemented in the at least one computing device, configure the at least one computing device for:

tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant.

25. The system of claim 24, wherein the tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant includes:

sampling at least a portion of the audio and/or video data representing the participant including at least one detected indicia of a modification of the audio and/or video data representing the participant.

26. The system of claim 24, wherein the tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant includes:

inserting a graphical element associated with at least one detected indicia of a modification of the video data representing the participant into the video data representing the participant.

27. The system of claim 24, wherein the tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant includes:

storing one or more time stamps associated with at least one detected indicia of a modification of the audio and/or video data representing the participant.

28. The system of claim 24, wherein the tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant includes:

tagging the audio and/or video data representing the participant according to at least one detected indicia of a modification of the audio and/or video data representing the participant in response to a user input.

29. A computer-implemented method comprising:

receiving audio and/or video data representing a participant in at least one of an audio or audio/video conferencing interaction with at least one other participant;

detecting at least one indicia of a prior modification of the audio and/or video data representing the participant;

determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant; and

providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant.

30. A non-transitory computer-readable medium comprising computer-readable instructions for executing a computer implemented method, the method comprising:

receiving audio and/or video data representing a participant in at least one of an audio or audio/video conferencing interaction with at least one other participant;

detecting at least one indicia of a prior modification of the audio and/or video data representing the participant;

determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant; and

providing a notification, to the at least one other participant, that is indicative of the determining that the at least one indicia of a prior modification of the audio and/or video data representing the participant masks at least one indicia of deception by the participant.