System and method using thermal image analysis and slope threshold classification for polygraph testing

• US 7,111,980 B2
• Filed: 11/13/2001
• Issued: 09/26/2006
• Est. Priority Date: 04/19/2001
• Status: Active Grant

• Current Assignee: Honeywell International Inc., Mayo Foundation For Medical Education And Research (Mayo Clinic)
• Original Assignee: Honeywell International Inc.
• Inventors: Levine, James A., Pavlidis, Ioannis
• Primary Examiner(s): VERBITSKY, GAIL KAPLAN
• Application Number:
  US10/008,786
• Publication Number:
  US 20030016726A1
• Time in Patent Office: 1,778 Days
• Field of Search: 374/121, 374/129, 374/45, 600/407
• US Class Current: 374/45
• CPC Class Codes: A61B 5/015 By temperature mapping of body part
• CPC Class Codes: A61B 5/0261 using optical means, e.g. infrared light
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/164 Lie detection
• CPC Class Codes: A61B 5/7264 Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems neural networks per se G06N3/00; expert systems per se G06N5/00

Abstract

Thermal image data of at least a region of a face of a person is provided. The thermal image data is transformed to blood flow rate data which includes a slope representative of the change of blood flow rate over time. The slope is compared to a slope threshold to determine a physiological state of the person. For example, it may be determined whether the person is deceptive or non-deceptive, e.g., deceptive with respect to an elicited response from the person.

Claims

1. A method for use in detecting deception of a person, the method comprising:

providing thermal image data of at least a region of a face of a person;

transforming the thermal image data to blood flow rate data, wherein the blood flow rate data comprises a slope representative of change of blood flow rate over time;

providing a slope threshold representative of a demarcation between change of blood flow rate over time for a deceptive person and change of blood flow rate over time for a non-deceptive person; and

comparing the slope representative of change of blood flow rate over time to the slope threshold to determine whether the person is deceptive or non-deceptive.

2. The method of claim 1, wherein providing a slope threshold comprises generating a slope threshold based on at least answer slopes representative of the change of blood flow rate over time for a plurality of subjects during at least a portion of an answer period of time in which the plurality of subjects answer questions posed thereto.

3. The method of claim 1, wherein providing a slope threshold comprises generating a slope threshold based on answer slopes representative of the change of blood flow rate over time for a plurality of subjects during at least a portion of an answer period of time in which the plurality of subjects answer questions posed thereto during a question period of time and also based on question slopes representative of the change of blood flow rate over time for a plurality of subjects during at least a portion of the question period of time.

4. The method of claim 3, wherein providing a slope threshold comprises generating a slope threshold based on a product of corresponding question and answer slopes.

5. The method of claim 1, wherein providing the thermal image data comprises providing thermal image data of at least a region proximate an eye of the person.

6. The method of claim 1, wherein providing thermal image data comprises:

asking the person a question to elicit a response therefrom;

focusing a thermal infrared image device operable to provide thermal image data on at least the region of the face of the person; and

capturing thermal image data during at least a period of time during the response from the person.

7. The method of claim 6, wherein determining whether the person is deceptive or non-deceptive comprises determining whether the person is being deceptive or non-deceptive with respect to the response to the question.

8. The method of claim 1, wherein providing thermal image data comprises:

focusing a thermal infrared image device operable to provide thermal image data on at least the region of the face of the person;

capturing frames of thermal image data during at least a period of time; and

tracking movement of at least the region of the face of the person.

9. A system for use in detecting deception of a person, the system comprising:

a thermal infrared image device operable to provide thermal image data of at least a region of a face of a person; and

a computing apparatus operable to;

transform the thermal image data to blood flow rate data, wherein the blood flow rate data comprises a slope representative of change of blood flow rate over time;

provide a slope threshold representative of a demarcation between change of blood flow rate over time for a deceptive person and change of blood flow rate over time for a non-deceptive person; and

compare the slope representative of change of blood flow rate over time for a person to the slope threshold to determine the person as deceptive or non-deceptive.

10. The system of claim 9, wherein the slope threshold is provided based on at least answer slopes representative of the change of blood flow rate over time for a plurality of subjects during at least a portion of an answer period of time in which the plurality of subjects answer questions posed thereto.

11. The system of claim 9, wherein the slope threshold is provided based on answer slopes representative of the change of blood flow rate over time for a plurality of subjects during at least a portion of an answer period of time in which the plurality of subjects answer questions posed thereto during a question period of time and also on question slopes representative of the change of blood flow rate over time for a plurality of subjects during at least a portion of the question period of time.

12. The system of claim 11, wherein the slope threshold is based on a product of corresponding question and answer slopes.

13. The system of claim 9, wherein the thermal infrared image device is operable to provide thermal image data of at least a region proximate an eye of the person.

14. The system of claim 9, wherein the thermal infrared image device is operable to capture thermal image data during at least a period of time during at least an elicited response from the person.

15. The system of claim 14, wherein the computing apparatus is operable to determine whether the person is deceptive or non-deceptive based on the blood flow rate data corresponding to the thermal image data captured during at least the elicited response.

16. The system of claim 9, wherein the thermal infrared image device is operable to capture frames of thermal image data during at least a period of time, and further wherein the computing apparatus is further operable to track movement of at least the region of the face of the person during the period of time.

17. The system of claim 9, wherein the system further comprises means for providing measurement of one or more physiological parameters different than blood flow rate data obtained using thermal image data, and further wherein the computing apparatus is operable to determine whether the person is deceptive or non-deceptive based on the blood flow rate data obtained using thermal image data and the one or more physiological parameters.

18. A polygraph method for use in determining whether a person is being deceptive or non-deceptive with respect to a response elicited from the person, the method comprising:

capturing thermal image data from at least one region of the face of the person during at least the elicited response;

transforming the thermal image data to blood flow rate data, wherein the blood flow rate data comprises a slope representative of change of blood flow rate over time in the at least one region of the face;

providing a slope threshold representative of a demarcation between change of blood flow rate over time for a deceptive person and change of blood flow rate over time for a non-deceptive person; and

comparing the slope representative of change of blood flow rate over time for the person to the slope threshold to classify the person'"'"'s elicited response as deceptive or non-deceptive.

19. The method of claim 18, wherein providing a slope threshold comprises generating a slope threshold based on at least answer slopes representative of the change of blood flow rate over time for a plurality of subjects during at least a portion of an answer period of time in which the plurality of subjects answer questions posed thereto.

20. The method of claim 18, wherein providing a slope threshold comprises generating a slope threshold based on answer slopes representative of the change of blood flow rate over time for a plurality of subjects during at least a portion of an answer period of time in which the plurality of subjects answer questions posed thereto during a question period of time and also based on question slopes representative of the change of blood flow rate over time for a plurality of subjects during at least a portion of the question period of time.

21. The method of claim 20, wherein providing a slope threshold comprises generating a slope threshold based on a product of corresponding question and answer slopes.

22. The method of claim 18, wherein capturing the thermal image data comprises capturing thermal image data of at least a region proximate an eye of the person.

23. The method of claim 18, wherein the method further comprises providing measurement of one or more physiological parameters different than blood flow rate data obtained using thermal image data, and further wherein classifying the person elicited response as deceptive or non-deceptive comprises determining whether the person is deceptive or non-deceptive based on the blood flow rate data obtained using thermal image data and the one or more physiological parameters.

24. A method for use in determining a physiological state of a person, the method comprising:

providing thermal image data of at least a region of a face of a person;

transforming the thermal image data to blood flow rate data, wherein the blood flow rate data comprises a slope representative of change of blood flow rate over time;

providing a slope threshold representative of a demarcation between change of blood flow rate over time for a first physiological state of a person and change of blood flow rate over time for a second physiological state of a person; and

comparing the slope representative of change of blood flow rate over time to the slope threshold to determine whether the person is in the first or second physiological state.

25. The method of claim 24, wherein the first physiological state of a person and the second physiological state of a person comprise a deceptive state and a non-deceptive state, respectively.

26. The method of claim 24, wherein providing the thermal image data comprises providing thermal image data of at least a region proximate an eye of the person.

27. The method of claim 24, wherein providing thermal image data comprises:

focusing a thermal infrared image device operable to provide thermal image data on at least the region of the face of the person;

capturing frames of thermal image data during at least a period of time; and

tracking movement of at least the region of the face of the person.

28. A system for use in determining a physiological state of a person, the system comprising:

a thermal infrared image device operable to provide thermal image data of at least a region of a face of a person; and

a computing apparatus operable to;

transform the thermal image data to blood flow rate data, wherein the blood flow rate data comprises a slope representative of change of blood flow rate over time;

provide a slope threshold representative of a demarcation between change of blood flow rate over time for a first physiological state of a person and change of blood flow rate over time for a second physiological state of a person; and

compare the slope representative of change of blood flow rate over time to the slope threshold to determine whether the person is in the first or second physiological state.

29. The system of claim 28, wherein the first physiological state of a person and the second physiological state of a person comprise a deceptive state and a non-deceptive state, respectively.

30. The system of claim 28, wherein the thermal infrared image device is operable to provide thermal image data of at least a region proximate an eye of the person.

31. The system of claim 28, wherein the thermal infrared image device is operable to capture frames of thermal image data during at least a period of time, and further wherein the computing apparatus is further operable to track movement of at least the region of the face of the person during the period of time.