System for indicating deceit and verity

• US 20080260212A1
• Filed: 01/11/2008
• Published: 10/23/2008
• Est. Priority Date: 01/12/2007
• Status: Abandoned Application

• Current Assignee: Jared Delbert Holsopple, Michael D. Moskal, Philip Charles Kilinskas, Thomas Edward Slowe, Venugopal Govindaraju
• Original Assignee: Jared Delbert Holsopple, Michael D. Moskal, Philip Charles Kilinskas, Thomas Edward Slowe, Venugopal Govindaraju
• Inventors: Govindaraju, Venugopal, Slowe, Thomas Edward, Holsopple, Jared Delbert, Moskal, Michael D., Kilinskas, Philip Charles
• Application Number:
  US12/008,511
• Publication Number:
  US 20080260212A1
• Time in Patent Office: Days
• US Class Current: 382/118
• CPC Class Codes: A61B 5/1079 using optical or photographic means
• CPC Class Codes: A61B 5/164 Lie detection
• CPC Class Codes: A61B 5/7267 involving training the classification device
• CPC Class Codes: G06V 40/1371 Matching features related to minutiae or pores
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/176 Dynamic expression

Abstract

An improved method for detecting truth or deceit (15) comprising providing a video camera (18) adapted to record images of a subject'"'"'s (16) face, recording images of the subject'"'"'s face, providing a mathematical model (62) of a face defined by a set of facial feature locations and textures, providing a mathematical model of facial behaviors (78, 82, 98, 104) that correlate to truth or deceit, comparing (64) the facial feature locations to the image (29) to provide a set of matched facial feature locations (70), comparing (77, 90, 94, 100) the mathematical model of facial behaviors to the matched facial feature locations, and providing a deceit indication as a function of the comparison (78, 91, 95, 101 or 23).

Claims

1. A computerized method for detecting truth or deceit comprising the steps of:

providing a video camera adapted to record images of a subject'"'"'s face;

recording images of said subject'"'"'s face;

providing a mathematical model of a face defined by a set of facial feature locations and textures;

providing a mathematical model of facial behavior that correlates to truth or deceit;

comparing said facial feature locations to said image to provide a set of matched facial feature locations;

comparing said mathematical model of facial behaviors to said matched facial feature locations; and

providing a deceit indication as a function of said comparison.

2. The method set forth in claim 1, wherein said camera detects light in the visual spectrum.

3. The method set forth in claim 1, wherein said camera detects light in the infrared spectrum

4. The method set forth in claim 1, wherein said camera is a digital camera.

5. The method set forth in claim 1, wherein said camera provides an analog signal and further comprising the step of digitizing said signal.

6. The method set forth in claim 1, wherein said image comprises a matrix of pixels.

7. The method set forth in claim 6, wherein said pixels are comprised of a set of numbers coincidentally spacially located in a matrix associated with said image.

8. The method set forth in claim 6, wherein said pixels are defined by a set of three numbers and said numbers are associated with red, green and blue values.

9. The method set forth in claim 1, wherein said facial behavior is selected from a group consisting of anger, sadness, fear, enjoyment and symmetry.

10. The method set forth in claim 9, wherein said facial behavior is anger and comprises a curvature of the mouth of the subject.

11. The method set forth in claim 9, wherein said facial behavior is sadness and comprises relative displacement of points on a mouth and a change in pixel values on or about a forehead.

12. The method set forth in claim 9, wherein said facial behavior is enjoyment and comprises relative displacements of points on a mouth and a change in pixel values in a vertical direction near the corner of an eye.

13. The method set forth in claim 9, wherein said facial behavior is fear and comprises a change in pixel values on or about a forehead.

14. The method set forth in claim 1, wherein said step of comparing said facial feature locations to said image comprises modifying said model facial feature locations to correlate to said image.

15. The method set forth in claim 1, wherein said step of comparing said facial feature locations to said image comprises modifying said image to correlate to said model.

16. The method set forth in claim 1, wherein said step of comparing said facial feature locations to said image comprises converging said model to said image.

17. The method set forth in claim 1, wherein said step of comparing said mathematical model of facial behaviors to said matched facial feature locations is a function of pixel values.

18. The method set forth in claim 1, wherein said deceit indication is provided on a frame-by-frame basis.

19. The method set forth in claim 18, and further comprises the step of filtering deceit indication values over multiple frames.

20. The method set forth in claim 1, wherein said deceit indication is a value between zero and one.

21. The method set forth in claim 1, wherein said deceit indication is a function of an audio deceit indicator.

22. The method set forth in claim 1, wherein said deceit indication is a function of facial symmetry.

23. The method set forth in claim 1, wherein said deceit indication is a function of speed of facial change.

24. An system for detecting truth or deceit comprising:

a video camera adapted to record images of a subject'"'"'s face;

a processor communicating with said video camera;

said processor having a mathematical model of a face defined by a set of facial feature locations and textures and a mathematical model of facial behavior that correlates to truth or deceit;

said processor programmed to;

compare said facial locations to said image to provide a set of matched facial feature locations,

compare said mathematical model of facial behaviors to said matched facial feature locations, and

provide a deceit indication as a function of said facial comparison.

25. The system set forth in claim 24, and further comprising a microphone for recording said subject'"'"'s voice, said microphone communicating with said processor and said processor programmed to provide a voice deceit indication.

26. The system set forth in claim 25, wherein said deceit indication is a function of said facial comparison and said voice deceit indication.

27. The system set forth in claim 24, and further comprising a biometric database, said processor programmed to identify biometric information in a database of information for said subject.

28. The system set forth in claim 24, wherein said camera detects light in the visual spectrum.

29. The system set forth in claim 24, wherein said camera detects light in the infrared spectrum

30. The system set forth in claim 24, wherein said camera is a digital camera.

31. The system set forth in claim 24, wherein said camera provides an analog signal and further comprising a digitizer for said signal.

32. The system set forth in claim 24, wherein said image comprises a matrix of pixels.

33. The system set forth in claim 32, wherein said pixels are comprised of a set of numbers coincidentally spacially located in a matrix associated with said image.

34. The system set forth in claim 32, wherein said pixels are defined by a set of three numbers and said numbers are associated with red, green and blue values.

35. The system set forth in claim 24, wherein said facial behavior is selected from a group consisting of anger, sadness, fear, enjoyment and symmetry.

36. The system set forth in claim 35, wherein said facial behavior is anger and comprises a curvature of the mouth of the subject.

37. The system set forth in claim 35, wherein said facial behavior is sadness and comprises relative displacement of points on a mouth and a change in pixel values on or about a forehead.

38. The system set forth in claim 35, wherein said facial behavior is enjoyment and comprises relative displacements of points on a mouth and a change in pixel values in a vertical direction near the corner of an eye.

39. The system set forth in claim 35, wherein said facial behavior is fear and comprises a change in pixel values on or about a forehead.

40. The system set forth in claim 24, wherein said processor is programmed to modify said model facial feature locations to correlate to said image.

41. The system set forth in claim 24, wherein said processor is programmed to modify said image to correlate to said model.

42. The method set forth in claim 24, wherein said processor is programmed to converge said model to said image.

43. The system set forth in claim 24, wherein said deceit indication is provided on a frame-by-frame basis.

44. The system set forth in claim 43, wherein said processor is programmed to filter deceit indication values over multiple frames.

45. The system set forth in claim 24, wherein said deceit indication is a value between zero and one.

46. The system set forth in claim 24, wherein said deceit indication is a function of an audio deceit indicator.

47. The system set forth in claim 24, wherein said deceit indication is a function of facial symmetry.

48. The system set forth in claim 24, wherein said deceit indication is a function of speed of facial change.

49. A computer readable medium having computer-executable instructions for performing a method comprising:

providing a mathematical model of a face defined by a set of facial feature locations and textures;

providing a mathematical model of facial behavior that correlates to truth or deceit;

comparing said facial feature locations to a video image of a subject'"'"'s face to provide a set of matched facial feature locations;

comparing said mathematical model of facial behaviors to said matched facial feature locations; and

providing a deceit indication as a function of said comparison.

50. The medium set forth in claim 49, wherein said facial behavior is selected from a group consisting of anger, sadness, fear, enjoyment and symmetry.

51. The medium set forth in claim 50, wherein said facial behavior is anger and comprises a curvature of the mouth of the subject.

52. The medium set forth in claim 50, wherein said facial behavior is sadness and comprises relative displacement of points on a mouth and a change in pixel values on or about a forehead.

53. The medium set forth in claim 50, wherein said facial behavior is enjoyment and comprises relative displacements of points on a mouth and a change in pixel values in a vertical direction near the corner of an eye.

54. The medium set forth in claim 50, wherein said facial behavior is fear and comprises a change in pixel values on or about a forehead.

55. The medium set forth in claim 49, wherein said step of comparing said facial feature locations to said image comprises modifying said model facial feature locations to correlate to said image.

56. The medium set forth in claim 49, wherein said step of comparing said facial feature locations to said image comprises modifying said image to correlate to said model.

57. The medium set forth in claim 49, wherein said step of comparing said facial feature locations to said image comprises converging said model to said image.

58. The medium set forth in claim 49, wherein said step of comparing said mathematical model of facial behavior to said matched facial feature locations is a function of pixel values.