Physiological-based detection and tagging in communications data

• US 10,380,097 B1
• Filed: 12/17/2015
• Issued: 08/13/2019
• Est. Priority Date: 12/17/2015
• Status: Active Grant

• Current Assignee: Securus Technologies Incorporated (Securus Special Investments LLC)
• Original Assignee: Securus Technologies Incorporated (Securus Special Investments LLC)
• Inventors: Walters, Arthur P.
• Primary Examiner(s): Hwa, Shyue Jiunn
• Application Number:
  US14/973,171
• Time in Patent Office: 1,335 Days
• CPC Class Codes: G06F 16/22 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/2358 Change logging, detection, and notification replication G06F16/27
• CPC Class Codes: G06F 16/61 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/686 using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
• CPC Class Codes: G06F 16/71 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/784 the detected or recognised objects being people
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06Q 40/08 Insurance
• CPC Class Codes: G06Q 50/26 Government or public services business processes related to the transportation industry G06Q50/40
• CPC Class Codes: G06V 40/15 Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

Systems and methods for detecting changes in physiological indicators in communications data of participants of a communication and tagging those changes are described. According to an embodiment, a method uses an analytics module operating on at least one processor. Data indicative of a communication between participants is received. A physiological indicator of at least one of the participants is detected by analyzing the data. A change in the physiological indicator is determined in the data. A location of the data where the change in the physiological indicator occurred in the data is tagged. The tagging includes storing a tag indicating the location of the data where the change in physiological indicator occurred in memory.

Claims

1. A method comprising:

using an analytics module operating on at least one processor;

receiving a recorded conversation between participants;

detecting a physiological indicator of a participant by analyzing the recorded conversation;

determining a change in the physiological indicator of the participant during the recorded conversation; and

tagging a location in the recorded conversation where the change in the physiological indicator occurred in the recorded conversation, the tagging including storing a tag indicating the location in the recorded conversation where the change in the physiological indicator occurred.

2. The method of claim 1, wherein the recorded conversation includes a video of the recorded conversation.

3. The method of claim 1, wherein the recorded conversation includes an audio recording.

4. The method of claim 1 further comprising:

using a recording module operating on at least one processor;

receiving the recorded conversation from a video-capturing device, an audio-capturing device, or a combination thereof; and

storing the recorded conversation in a database operating on a database device.

5. The method of claim 1, wherein the physiological indicator includes heart rate, blood pressure, breathing rate, facial expressions, body temperature, speaking volume, speaking rate, voice frequency, or a combination thereof.

6. The method of claim 1 further comprising, using the analytics module, transmitting an indication of the change in the physiological indicator to a terminal in real-time with the recording of the conversation, a user having access to the terminal during the recording of the conversation.

7. The method of claim 1, wherein the determining the change in the physiological indicator includes:

determining a baseline of the physiological indicator from the recorded conversation; and

determining when the physiological indicator deviates from the baseline during the recorded conversation.

8. The method of claim 1, wherein the determining the change in the physiological indicator includes:

determining a baseline of the physiological indicator from the recorded conversation; and

determining when the physiological indicator deviates from the baseline in the recorded conversation by at least a threshold value.

9. The method of claim 1, wherein the tag includes a label describing the determined change in the physiological indicator.

10. The method of claim 1, wherein the tag includes a keyword indicative of the physiological indicator.

11. A system comprising:

a database device having a database management system operable on at least one processor and having a database memory for storing a database; and

an analytics system having an analytics module operable on at least one processor, the analytics system being operatively coupled to the database device, the analytics module being operable to receive communications data representative of a recorded conversation between at least two participants, the recorded conversation including video data, audio data, or a combination thereof, the analytics module further being operable to identify a physiological indicator of a participant in the recorded conversation, operable to determine a change in the physiological indicator of the participant in the recorded conversation, and operable to transmit a tag to the database device, the tag indicating a location in the recorded conversation where the change in the physiological indicator occurred, the database management system being operable to store the recorded conversation and the tag in the database memory.

12. The system of claim 11 further comprising:

an audio device operatively coupled to the analytics system, the audio device operable to capture the audio data of the recorded conversation; and

a video device operatively coupled to the analytics system, the video device operable to capture the video data of the recorded conversation.

13. The system of claim 12, wherein the video device further includes an infrared detector.

14. The system of claim 11, wherein the analytics system further has a recording module operable on at least one processor, the recording module being operable to transmit the recorded conversation to the database device for storing the recorded conversation in the database.

15. The system of claim 11 further comprising a terminal operatively coupled to the analytics system, the analytics module being operable to transmit an indication of the change to the terminal in real-time during the recording of the conversation between the participants.

16. A non-transitory computer-readable storage medium having a computer program embodied thereon, the computer program comprising:

program code instructions for detecting a physiological indicator of a participant in a recorded conversation, the recorded conversation including video data, audio data, or a combination thereof;

program code instructions for determining a change in the physiological indicator of the participant during the recorded conversation; and

program code instructions for storing the recorded conversation and a tag to memory, the tag indicating a location in the recorded conversation where the change in the physiological indicator occurred.

17. The non-transitory computer-readable storage medium of claim 16, wherein the tag includes a label describing the determined change in the physiological indicator.

18. The non-transitory computer-readable storage medium of claim 16, wherein the physiological indicator includes heart rate, blood pressure, breathing rate, facial expressions, body temperature, speaking volume, speaking rate, voice frequency, or a combination thereof.

19. The non-transitory computer-readable storage medium of claim 16, wherein the program code instructions for determining the change in the physiological indicator comprises:

program code instructions for determining a baseline of the physiological indicator from the recorded conversation; and

program code instructions for determining when the physiological indicator deviates from the baseline in the recorded conversation by at least a threshold value.

20. The non-transitory computer-readable storage medium of claim 16, wherein the tag further includes a keyword indicative of the physiological indicator.