Secure nonscheduled video visitation system

• US 9,558,523 B1
• Filed: 03/23/2016
• Issued: 01/31/2017
• Est. Priority Date: 03/23/2016
• Status: Active Grant

• Current Assignee: Global Tel-Link Corporation
• Original Assignee: Global Tel-Link Corporation
• Inventors: Hodge, Stephen Lee
• Primary Examiner(s): Anwah, Olisa
• Application Number:
  US15/078,724
• Time in Patent Office: 314 Days
• Field of Search: 348/14.01, 348/14.05, 348/14.12
• US Class Current: 1/1
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2221/2139 Recurrent verification
• CPC Class Codes: G06Q 50/26 Government or public services business processes related to the transportation industry G06Q50/40
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/50 Maintenance of biometric data or enrolment thereof
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/06 Decision making techniques; Pattern matching strategies
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: H04N 7/15 Conference systems
• CPC Class Codes: H04N 7/155 involving storage of or access to video conference sessions tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831

Abstract

Described are methods and systems in which the censorship and supervision tasks normally performed by secured facility personnel are augmented or automated entirely by a Secure Nonscheduled Video Visitation System. In embodiments, the Secure Nonscheduled Video Visitation System performs voice biometrics, speech recognition, non-verbal audio classification, fingerprint and other biometric authentication, image object classification, facial recognition, body joint location determination analysis, and/or optical character recognition on the video visitation data. The Secure Nonscheduled Video Visitation utilizes these various analysis techniques in concert to determine if all rules and regulations enforced by the jurisdiction operation the secured facility are being followed by the parties to the video visitation session.

Claims

1. A secure nonscheduled video visitation system for use in a controlled environment, the system comprising:

an identity database;

a censorship database; and

a video visitation central processing platform containing one or more processors and/or circuits configured to;

connect a video visitation session between a local video communication device and a remote video communication device;

conduct a first analysis on video visitation data using the identity database to identify individuals party to the video visitation session, wherein a first signal is generated;

conduct a second analysis on the video visitation data using the censorship database to detect a presence of an entry in the censorship database in the video visitation data, wherein a second signal is generated; and

control a state of the video visitation session based on a sum of the first and second signals as weighted by a first and second weight;

wherein the video visitation session is not scheduled.

2. The system of claim 1, wherein the first analysis includes identifying speakers in audio data of the video visitation session using voice biometrics.

3. The system of claim 1, wherein the second analysis includes recognizing spoken words in audio data of the video visitation session using speech recognition.

4. The system of claim 1, wherein the second analysis includes classifying non-verbal audio in audio data of the video visitation session using non-verbal audio classification.

5. The system of claim 1, wherein the second analysis includes classifying objects in image data of the video visitation session using object classification.

6. The system of claim 1, wherein the first analysis includes identifying people in image data of the video visitation session using facial recognition.

7. The system of claim 1, wherein the second analysis includes identifying body location in image data of the video visitation session using body joint location determination.

8. The system of claim 1, wherein the second analysis includes identifying written characters in image data of the video visitation session using optical character recognition.

9. The system of claim 1, further comprising a biometric scanner, wherein the control of the state of the video visitation session is based in part on analysis of biometrics information gathered from the biometric scanner.

10. A method for secure nonscheduled video visitation for use in a controlled environment, the method comprising:

connecting an unscheduled video visitation session between a local video communication device and a remote video communication device;

analyzing the video visitation data to determine if content of the video visitation session is in accordance with a set of rules;

determining that the video visitation session is not in accordance with the set of rules, wherein a plurality of signals are generated; and

transmitting an alert that the video visitation session is not in accordance with the set of rules based on a weighted sum of the plurality of signals.

11. The method of claim 10, wherein the set of rules is determined by a jurisdiction operating a secured facility and the local video communication device is within the secured facility.

12. The method of claim 10, further comprising disconnecting the video visitation session in response to determining that the video visitation session is not in accordance with the set of rules.

13. The method of claim 10, further comprising making available a live feed of the video visitation session to an investigative workstation to monitor the video visitation session.

14. The method of claim 10, further comprising recording the video visitation session.

15. A method of aggregating an output of multiple video visitation analysis modules operating on video visitation data from an unscheduled video visitation session to produce a composite output, the method comprising:

receiving a first signal from a first analysis module, the first analysis module analyzing the video visitation data using an identity database to identify individuals party to the video visitation session;

receiving a second signal from a second analysis module, the second analysis module analyzing the video visitation data using a censorship database to detect a presence of restricted behavior in the video visitation data; and

setting the composite output based on a weighted sum of the first signal and the second signal.

16. The method of claim 15, wherein the composite output is set to indicate the video visitation session should be terminated if either the first or the second signal indicate the video visitation session should be terminated.

17. The method of claim 15, wherein the first signal is weighted by a first weight, and the second signal is weighted by a second weight, and the composite output is set to indicate that the video visitation session should be terminated if the sum of the first and second signals as weighted by the first and second weight indicate the video visitation session should be terminated.

18. The method of claim 15, wherein the composite output is set to indicate that the video visitation session should be terminated if the first signal indicates for a period of time greater than a threshold that the video visitation session should be terminated.

19. The method of claim 15, wherein the composite output is a Boolean value.

20. The method of claim 15, wherein the composite output is a number with a lower and upper bound.