Deception detection system and method

• US 10,390,747 B2
• Filed: 02/08/2017
• Issued: 08/27/2019
• Est. Priority Date: 02/08/2016
• Status: Active Grant

• Current Assignee: NuraLogix Corporation
• Original Assignee: NuraLogix Corporation
• Inventors: Lee, Kang, Zheng, Pu
• Primary Examiner(s): Bee, Andrew W
• Application Number:
  US16/076,492
• Publication Number:
  US 20190038200A1
• Time in Patent Office: 930 Days
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/02 Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/026 Measuring blood flow A61B3/1233, A61B3/1241 take precedence
• CPC Class Codes: A61B 5/0261 using optical means, e.g. infrared light
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/1032 Determining colour for diagnostic purposes measuring colour in general G01J3/46
• CPC Class Codes: A61B 5/14546 for measuring analytes not otherwise provided for, e.g. ions, cytochromes
• CPC Class Codes: A61B 5/1455 using optical sensors, e.g. spectral photometrical oximeters
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/164 Lie detection
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/318 Heart-related electrical modalities, e.g. electrocardiography [ECG]
• CPC Class Codes: A61B 5/443 Evaluating skin constituents, e.g. elastin, melanin, water
• CPC Class Codes: A61B 5/7267 involving training the classification device
• CPC Class Codes: A61B 5/7405 using sound
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 3/02 Neural networks
• CPC Class Codes: G06N 3/044 : Recurrent networks, e.g. Hopfield networks
• CPC Class Codes: G06N 3/08 : Learning methods
• CPC Class Codes: G06V 10/467 : Encoded features or binary features, e.g. local binary patterns [LBP]
• CPC Class Codes: G06V 10/60 : relating to illumination properties, e.g. using a reflectance or lighting model
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/174 : Facial expression recognition
• CPC Class Codes: G06V 40/176 : Dynamic expression
• CPC Class Codes: G08B 5/38 : using flashing light
• CPC Class Codes: G10L 15/22 : Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 25/63 : for estimating an emotional state
• CPC Class Codes: G16H 50/70 : for mining of medical data, e.g. analysing previous cases of other patients

Abstract

A system for detecting deception is provided. The system comprises a camera, an image processing unit, and a notification device. The camera is configured to capture an image sequence of a person of interest. The image processing unit is trained to determine a set of bitplanes of a plurality of images in the captured image sequence that represent the hemoglobin concentration (HC) changes of the person, and to detect the person'"'"'s invisible emotional states based on HC changes. The image processing unit is trained using a training set comprising a set of subjects for which emotional state is known. The notification device provides a notification of at least one of the person'"'"'s detected invisible emotional states.

Claims

1. A system for detecting deception for the security screening of a person of interest by an attendant, the system comprising:

a camera configured to capture an image sequence of the person of interest;

a processing unit trained to determine a set of bitplanes of a plurality of images in the captured image sequence that represent the hemoglobin concentration (HC) changes of the person, to detect the person'"'"'s invisible emotional states based on HC changes, and to output the detected invisible emotional states, the processing unit being trained using a training set comprising HC changes of subjects with known emotional states; and

,

a notification device for providing a notification of at least one of the person'"'"'s detected invisible emotional states to the attendant based on the output of the processing unit.

2. The system of claim 1, wherein the processing unit is configured to calculate a probability of deception of the person being screened based on the emotions detected and their determined intensity, and the notification device is configured to present the calculated probability of deception to the attendant.

3. The system of claim 2, wherein the notification is configured to draw the attention of the attendant if the probability of deception exceeds a predetermined value.

4. The system of claim 3, wherein the notification comprises a flash to draw the attention of the attendant.

5. The system of claim 3, wherein the notification comprises an audible noise.

6. The system of claim 2, wherein the notification comprises a color coded visual indicator indicative of the detected invisible emotion and its intensity.

7. The system of claim 6, wherein a positive invisible emotion is depicted as green and a deceptive human emotion is depicted as red.

8. The system of claim 2, wherein the notification comprises a summary report of the probability of deception during the screening of the person.

9. The system of claim 8, wherein the camera is further configured to capture an audio sequence in addition to the image sequence, and the processing unit is further configured to process the audio sequence to determine a set of questions posed to the person during the screening, and the probability of deception in the summary report is visually correlated to the questions.

10. A method for detecting deception for the security screening of a person of interest by an attendant, the method comprising:

capturing, by a camera, an image sequence of the person of interest;

determining, by a processing unit, a set of bitplanes of a plurality of images in the captured image sequence that represent the hemoglobin concentration (HC) changes of the person, detecting the person'"'"'s invisible emotional states based on HC changes, and outputting the detected invisible emotional states, the processing unit being trained using a training set comprising HC changes of subjects with known emotional states; and

,

providing a notification, by a notification device, of at least one of the person'"'"'s detected invisible emotional states to the attendant based on the output of the processing unit.

11. The method of claim 10, further comprising, calculating, by the processing unit, a probability of deception of the person being screened based on the emotions detected and their determined intensity, and, presenting, by the notification device, the probability of deception to the attendant.

12. The method of claim 11, wherein the notification is configured to draw the attention of the attendant if the probability of deception exceeds a predetermined value.

13. The method of claim 12, wherein the notification comprises a flash to draw the attention of the attendant.

14. The method of claim 12, wherein the notification comprises an audible noise.

15. The method of claim 11, wherein the notification comprises a color coded visual indicator indicative of the detected invisible emotion and its intensity.

16. The method of claim 15, wherein a positive invisible emotion is depicted as green and a deceptive human emotion is depicted as red.

17. The method of claim 11, wherein the notification comprises a summary report of the probability of deception during the screening of the person.

18. The method of claim 17, further comprising, capturing, by the camera, an audio sequence in addition to the image sequence, and processing, by the processing unit, the audio sequence to determine a set of questions posed to the person during the screening, and visually correlating, by the processing unit, the probability of deception to the questions in the summary report.