Deceptive indicia notification in a communications interaction

• US 9,378,366 B2
• Filed: 11/30/2011
• Issued: 06/28/2016
• Est. Priority Date: 11/30/2011
• Status: Active Grant

• Current Assignee: Elwha LLC (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Tegreene, Clarence T., Levien, Royce A., Lord, Richard T., Lord, Robert W., Malamud, Mark A.
• Primary Examiner(s): Le, David
• Application Number:
  US13/373,798
• Publication Number:
  US 20130139253A1
• Time in Patent Office: 1,672 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/164 Lie detection
• CPC Class Codes: G06F 21/554 involving event detection and direct action
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

Systems, methods, computer-readable storage mediums including computer-readable instructions and/or circuitry for monitoring deceptive indicia in communications content may implement operations including, but not limited to: receiving one or more signals associated with communication content provided by a first participant in a communications interaction; detecting one or more indicia of deception associated with the one or more signals associated with the communication content; and providing a notification associated with the one or more indicia of deception associated with the communication content to a second participant in the communications interaction receiving the communication content.

Claims

1. A system comprising:

at least one computing device; and

one or more instructions that, when implemented in the computing device, configure the at least one computing device for;

receiving audio and/or video conferencing data representing a first participant in at least one conferencing interaction with at least one second participant;

receiving audio and/or video conferencing data representing the at least one second participant in the at least one conferencing interaction with the first participant;

detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction; and

presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction.

2. The system of claim 1, wherein the detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction includes:

detecting one or more micro expressions of the first participant in video data representing the first participant in at the least one conferencing interaction.

3. The system of claim 1, wherein the detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction includes:

detecting an eye dilation of the first participant in video data representing the first participant in the least one conferencing interaction.

4. The system of claim 1, wherein the detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction includes:

detecting an eye movement of the first participant in video data representing the first participant in the least one conferencing interaction.

5. The system of claim 1, wherein the detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction includes:

detecting a heart rate of the first participant in audio and/or video data representing the first participant in the at least one conferencing interaction.

6. The system of claim 1, wherein the detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction includes:

detecting a blood pressure of the first participant in video data representing the first participant in the at least one conferencing interaction.

7. The system of claim 1, wherein the detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction includes:

detecting a perspiration level of the first participant in video data representing the first participant in the at least one conferencing interaction.

8. The system of claim 1, wherein the detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction includes:

detecting a breathing rate of the first participant in audio and/or video data representing the first participant in the at least one conferencing interaction.

9. The system of claim 1, wherein the detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction includes:

detecting voice stress of the first participant in audio and/or video data representing the first participant in the at least one conferencing interaction.

10. The system of claim 1, wherein the detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction includes:

detecting characteristic language in audio data representing the first participant in the at least one conferencing interaction.

11. The system of claim 1, wherein the presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction includes:

displaying, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one visual indicator indicative of a number of instances of physiological indicia of deception by the first participant detected during the at least one audio or audio/video conferencing interaction.

12. The system of claim 1, wherein the presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction includes:

displaying, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one visual indicator indicative of a rate of occurrences of physiological indicia of deception by the first participant detected during the at least one audio or audio/video conferencing interaction.

13. The system of claim 1, wherein the presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction includes:

displaying, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one color coded visual indicator indicative of one or more instances of physiological indicia of deception by the first participant detected during the at least one audio or audio/video conferencing interaction.

14. The system of claim 1, wherein the presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction includes:

displaying, to the second participant within a specified half of a conferencing user interface presenting the conferencing interaction to the second participant, at least one visual indicator indicative of one or more physiological indicia of deception by the first participant detected during the at least one audio or audio/video conferencing interaction.

15. The system of claim 1, wherein the presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction includes:

emitting, to the second participant via an audio or audio/video conferencing user interface presenting the audio or audio/video conferencing interaction to the second participant, an audible notification indicative of one or more physiological indicia of deception by the first participant detected during the at least one audio or audio/video conferencing interaction.

16. The system of claim 1, wherein the presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction includes:

presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, a predictive notification of one or more potential physiological indicia of deception by the first participant during the at least one conferencing interaction.

17. The system of claim 16, wherein the presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, a predictive notification of one or more potential physiological indicia of deception by the first participant during the at least one conferencing interaction includes:

providing, to the second participant via a conferencing user interface presenting the at least one audio or audio/video conferencing interaction to the second participant, a notification indicative of a comparison of the audio and/or video data representing the first participant in the at least one conferencing interaction to at least a first threshold value and a second threshold value.

18. The system of claim 1, wherein the presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction includes:

displaying the indicator during presentation of the at least one conferencing interaction.

19. The system of claim 1, wherein the presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction includes:

displaying the visual indicator during playback of the at least one conferencing interaction.

20. The system of claim 1, further comprising:

one or more instructions that, when implemented in the computing device, configure the

at least one computing device for;

tagging the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction according to a detection of one or more physiological indicia of deception by the first participant.

21. The system of claim 20, wherein the tagging the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction according to a detection of one or more physiological indicia of deception by the first participant includes:

sampling at least a portion of the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction including at least one detected physiological indicia of deception by the first participant.

22. The system of claim 20 wherein the tagging the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction according to a detection of one or more physiological indicia of deception by the first participant includes:

inserting a graphical element into a video data file representing the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction.

23. The system of claim 20, wherein the tagging the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction according to a detection of one or more physiological indicia of deception by the first participant includes:

storing one or more time stamps corresponding to a detection of one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction.

24. The system of claim 20, wherein the tagging the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction according to a detection of one or more physiological indicia of deception by the first participant includes:

tagging the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction according to a detection of one or more physiological indicia of deception by the first participant in response to a user input.

25. A method comprising:

receiving audio and/or video conferencing data representing a first participant in at least one conferencing interaction with at least one second participant;

receiving audio and/or video conferencing data representing the at least one second participant in the at least one conferencing interaction with the first participant;

detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction; and

presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction.

26. A non-transitory computer-readable medium comprising computer-readable instructions for executing a computer implemented method, the method comprising:

receiving audio and/or video conferencing data representing a first participant in at least one conferencing interaction with at least one second participant;

receiving audio and/or video conferencing data representing the at least one second participant in the at least one conferencing interaction with the first participant;

detecting one or more physiological indicia of deception by the first participant in the audio and/or video conferencing data representing the first participant in the at least one conferencing interaction; and

presenting, to the second participant via a conferencing user interface presenting the at least one conferencing interaction to the second participant, at least one indicator indicating a detection of one or more physiological indicia of deception by the first participant occurring during the at least one conferencing interaction.