System and method for providing secure access to an electronic device using continuous facial biometrics

• US 8,370,639 B2
• Filed: 06/16/2005
• Issued: 02/05/2013
• Est. Priority Date: 06/16/2005
• Status: Active Grant

• Current Assignee: Sensible Vision Incorporated
• Original Assignee: Sensible Vision Incorporated
• Inventors: Azar, Cyrus, Brostoff, George
• Primary Examiner(s): Orgad, Edan
• Assistant Examiner(s): TURCHEN, JAMES R
• Application Number:
  US11/154,879
• Publication Number:
  US 20060288234A1
• Time in Patent Office: 2,791 Days
• Field of Search: 713/186
• US Class Current: 713/186
• CPC Class Codes: G06F 18/28 Determining representative reference patterns, e.g. by averaging or distorting; Generating dictionaries
• CPC Class Codes: G06F 21/316 by observing the pattern of computer usage, e.g. typical user behaviour
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/40 by quorum, i.e. whereby two or more security principals are required
• CPC Class Codes: G06F 2221/2101 Auditing as a secondary aspect
• CPC Class Codes: G06F 2221/2111 Location-sensitive, e.g. geographical location, GPS
• CPC Class Codes: G06F 2221/2137 Time limited access, e.g. to a computer or data
• CPC Class Codes: G06F 2221/2139 Recurrent verification
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06V 10/772 Determining representative reference patterns, e.g. averaging or distorting patterns; Generating dictionaries
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A facial biometric recognition system and method (100) for providing security for an electronic device (101) includes a digital camera (105) having a field of view for providing facial biometric images at a predetermined interval from a user of the electronic device (101). A processor (109) is associated with the electronic device (101) for comparing the facial biometric images to biometric image data stored in a database (107). The facial biometric images are continuously compared (111) to those stored in the database (107) or to facial image tracking (113) for providing substantially continuous authentication when the user physically moves about the camera'"'"'s field of view. The invention may be used with devices such as a personal computer (PC), mobile telephone, personal digital assistant (PDA) or gaming device and provides an efficient means by which to secure information on the device without the need for complex biometric security devices.

Claims

1. A facial biometric recognition system for providing security for an electronic device comprising:

a digital camera having a field of view for providing a plurality of facial biometric images from a user of the electronic device;

a database for storing first facial biometric image data after a first user authentication using a password entered using a keyboard associated with the electronic device;

at least one processor associated with the electronic device for executing the steps of;

comparing the plurality of facial biometric images to biometric image data stored in the database;

granting the user operational access to the electronic device;

updating the database with second facial biometric image data that is more recent in time than the first facial biometric image data if authentication has not occurred within a predetermined period of time and the user provides a second user authentication by entry of a password entered on the keyboard;

identifying prominent facial features of the user; and

tracking the prominent facial features when physically moving about the field of view of the digital camera for providing continuous user authentication.

2. A facial biometric recognition system as in claim 1, wherein the plurality of facial biometric images are provided by the digital camera in real-time.

3. A facial biometric recognition system as in claim 1, wherein the plurality of facial biometric images include time stamps.

4. A facial biometric recognition system as in claim 1, further comprising the step of:

providing authentication credentials to the at least one processor before user facial biometric images are stored in the database.

5. A facial biometric recognition system as in claim 4, wherein the authentication credentials include both a user name and first password.

6. A facial biometric recognition system as in claim 4, wherein the authentication credentials include additional forms of biometric authentication.

7. A facial biometric recognition system as in claim 1, further comprising the step of:

using a previously stored image for authentication if a real-time facial biometric image cannot be used to provide authentication of the user.

8. A facial biometric recognition system as in claim 7, further comprising the step of:

using a second password before using a previously stored image.

9. A facial biometric recognition system as in claim 1, further comprising the step of:

disabling a display of the electronic device when no authentication is made between the real-time facial biometric images and those stored in the database.

10. A facial biometric recognition system as in claim 1, further comprising the step of:

disabling a display of the electronic device when tracking of the user'"'"'s presence is lost.

11. A facial biometric recognition system as in claim 10, further comprising the step of:

delaying disablement of the display for a predetermined time period if use of a peripheral device has been detected.

12. A facial biometric recognition system as in claim 10, wherein the peripheral device is at least one from the group of a mouse, keyboard or touch screen.

13. A facial biometric recognition system as in claim 1, wherein the electronic device is one from the group of personal computer, personal digital assistant (PDA), mobile telephone or gaming device.

14. A facial biometric recognition system as in claim 1, wherein the step of updating includes the step of:

replacing a biometric image in the database that has resulted in the least success in authentication.

15. A method for providing security for an electronic device using facial biometric information comprising the steps of:

using a plurality of facial biometric images provided from a digital imaging device;

utilizing at least one processor for authenticating the identity of the user using a first user authentication by using at least one password entered using a keyboard associated with the electronic device;

storing digital imaging information about the user in a database;

updating the database with a new image if authentication has not occurred within a predetermined period of time and the user is later authenticated using a second user authentication by entry of at least one password entered on the keyboard;

providing continuous user authentication when the user physically moves about a field of view of the digital imaging device by tracking the prominent facial features without comparing facial biometric images; and

disabling utility of the electronic device if no user authentication is made within a predetermined time period.

16. A method for providing security as in claim 15, wherein the step of providing continuous user authentication includes the step of:

comparing a real-time image from the digital camera with one stored in the database.

17. A method for providing security as in claim 15, wherein the step of providing continuous user authentication includes the step of:

detecting the user'"'"'s presence in field of view of the digital imaging device.

18. A method for providing security as in claim 15, wherein the facial biometric images from the digital imaging device are provided in real-time.

19. A method for providing security as in claim 15, further comprising the step of:

automatically enrolling a user in the database based on an authentication of a plurality of real-time facial biometric images.

20. A method for providing security as in claim 15, further comprising the steps of:

accessing operation to the electronic device by manually entering first authentication credentials; and

populating the database using the plurality of facial biometric images from the digital imaging device obtained after access to the electric device.

21. A method for providing security as in claim 18, further comprising the step of:

providing a time stamp for each of the real-time facial biometric images.

22. A method for providing facial biometric security as in claim 15, wherein the step of updating includes the step of:

replacing a biometric image in the database that has resulted in the least success in authentication.

23. A method for providing facial biometric security as in claim 15, further comprising the step of:

utilizing second authentication credentials independent of the first authentication credentials before updating the database.

24. A method for providing security as in claim 15, further comprising the step of:

delaying the step of disabling if any activity is detected from a peripheral device.

25. A method for providing security as in claim 24, wherein the peripheral device is at least one from the group of keyboard, mouse and touch screen.

26. A method for providing security as in claim 15, wherein the electronic device is at least one from the group of personal computer, personal digital assistant (PDA), mobile telephone or gaming device.

27. A system for providing electronic biometric security for an electronic device comprising:

a camera for providing a plurality of digital images;

a database located in the electronic device for storing digital image information;

at least one microprocessor performing the steps of;

authenticating user identity based on entry of a first password;

storing information in the database from at least one real-time digital image of an authenticated user;

utilizing a previously authenticated image in the database if the real-time digital images stored over a series of frames in a memory cannot be used to provide authentication of the user;

identifying prominent facial features of the user;

tracking the user using the prominent facial features while in a field of view of the camera for providing continuous authentication; and

continuing user access to the electronic device as long as the user remains authenticated.

28. A system for providing electronic security as in claim 27, further comprising the step of:

disabling the tracking step at the option of the user; and

providing a continuous comparison of a real-time image from the camera to an image stored in the database from the authenticated user.

29. A system for providing electronic security as in claim 27, wherein the digital image information includes at least the face of the authenticated user.

30. A system for providing electronic security as in claim 27, further comprising the step of:

disabling the electronic device by using the at least microprocessor if the user is not authenticated.

31. A system for providing electronic security as in claim 30, further comprising the step of:

waiting a predetermined time period before disabling the electronic device.

32. A system for providing electronic security as in claim 30, further comprising the step of:

disabling the electronic display when the electronic device is disabled.

33. A system for providing electronic security as in claim 30, further comprising the step of:

delaying disablement for a predetermined time period if a peripheral device associated with the electronic device is detected.

34. A system for providing electronic security as in claim 27, wherein the step of updating includes the steps of:

time stamping the plurality of digital images when stored in the database;

identifying a digital image stored in the database having an earlier time stamp; and

replacing a digital image in the database that has resulted in the least success in authentication and has the oldest time stamp.

35. A system for providing electronic security as in claim 34, wherein the peripheral device includes at least one from the group of a mouse, keyboard or touch screen.

36. A system for providing electronic security as in claim 27, wherein the electronic device is at least one from the group of personal computer (PC), personal digital assistant (PDA), cellular telephone or gaming device.

37. An electronic device using facial biometric security for providing access to the electronic device comprising:

a digital camera for providing a plurality of real-time user images;

a database for storing at least one of the plurality of user images after the user has entered first valid authentication credentials such that a biometric image that has been stored the longest time and has resulted in the least success in authentication is the first replaced;

a microprocessor for comparing the plurality of user images with the at least one image stored in the memory for providing user authentication; and

wherein the microprocessor performs the steps of;

granting access to the electronic device when the user is authenticated;

utilizing a previously authenticated image in the database if the real-time digital images stored over a series of frames in memory cannot be used to provide authentication of the user;

identifying prominent facial features of the user; and

tracking the user using the prominent facial features when physically moving about the field of view of the digital camera for providing a continuous authentication without comparing user images.

38. An electronic device using facial biometric security as in claim 37, further comprising the step of:

time stamping the plurality of user images.

39. An electronic device as in claim 38, further comprising the step of:

updating the memory after the user has entered valid authentication credentials with the user'"'"'s image having a previous time stamp if the user is not authenticated within a predetermined time period.

40. An electronic device as in claim 37, wherein the authentication credentials include at least one password.

41. An electronic device as in claim 37, further comprising the step of:

disabling the functionality of the electronic device if the user is not authenticated within a predetermined time period; and

re-enabling functionality of the device when the user is again authenticated.

42. An electronic device as in claim 41, further comprising the step of:

delaying disablement is delayed if a peripheral device associated with the electronic device is detected as in use.

43. An electronic device as in claim 42, wherein the peripheral device is at least one from the group of mouse, keyboard or touch screen.

44. An electronic device as in claim 37, wherein the electronic device is at least one of a personal computer (PC), personal digital assistant (PDA), cellular telephone or gaming device.

45. A method for providing security for a user of a personal computer (PC) using facial biometrics comprising the steps of:

receiving from a digital camera a plurality of substantially real-time facial biometric images of a user stored in memory;

manually entering first authentication credentials using a password entered using a keyboard for providing access to the PC;

enrolling the user with at least one first stored image into a database if the first authentication credentials are valid;

updating the database with a second stored image if authentication has not occurred within a predetermined period of time and the user is later authenticated using second authentication credentials entered using a password entered with the keyboard;

replacing a biometric image in the memory from one in the database that has been stored the longest time and has resulted in the least success in authentication;

identifying prominent facial features of the user;

tracking the prominent facial features for providing substantially continuous authentication while the user remains within a field of view of the digital camera; and

allowing the user continued access to the PC as long as the user remains authenticated.

46. A method using the facial biometric images for providing security for a PC as in claim 45, further comprising the step of:

using a facial biometric image as the first stored image.

47. A method for providing security for a PC as in claim 45, further comprising the step of:

disabling a predetermined functionality of the PC if authentication has not been achieved within a predetermined time period.

48. A method for providing security for a PC as in claim 47, wherein the step of disabling includes providing a non-functional display.

49. A method for providing security for a PC as in claim 48, further comprising the step of:

delaying disablement of the display upon detection of a use of a peripheral device associated with the PC.

50. A method for providing security for a PC as in claim 49, wherein the peripheral device is a keyboard.

51. A method for providing security for a PC as in claim 49, wherein the peripheral device is a mouse.

52. A method for providing security for a PC as in claim 45, wherein the method is embodied in non-transitory machine readable software code executed on a personal computer.

53. A non-transitory computer readable medium having computer readable instructions stored thereon for execution by a processor to perform a method comprising the steps of:

using a plurality of facial biometric images provided from a digital imaging device input into a memory;

utilizing at least one processor for authenticating the identity of the user using a first user authentication having a password entered from a keyboard;

storing digital imaging information about the user in a database;

providing continuous user authentication when the user physically moves about a field of view of the digital imaging device by tracking the prominent facial features without comparing facial biometric images by comparing a real-time image from the digital camera with one stored in the database and updating the database with a new image if authentication has not occurred within a predetermined period of time and the user is later authenticated using a second user authentication entered using a password on the keyboard;

replacing a biometric image in the memory from one in the database that has been stored the longest time and has resulted in the least success in authentication; and

disabling utility of the electronic device if no user authentication is made within a predetermined time period.

54. A computer readable medium as in claim 53, wherein the step of providing continuous user authentication includes the step of:

detecting the user'"'"'s prominent facial features in field of view of the digital imaging device.

55. A computer readable medium as in claim 53, further comprising the step of:

automatically enrolling a user in the database based on an authentication of a plurality of real-time facial biometric images.

56. A computer readable medium as in claim 53, further comprising the steps of:

accessing operation to the electronic device by manually entering first authentication credentials; and

populating the database using the plurality of facial biometric images from the digital imaging device obtained after access to the electric device.

57. A computer readable medium as in claim 53, further comprising the step of:

providing a time stamp for each of the real-time facial biometric images.

58. A computer readable medium as in claim 57, further comprising the steps of:

identifying a facial biometric image stored in the database having an earlier time stamp; and

updating the database with the biometric image having the earlier time stamp if the real-time facial biometric images cannot be used to authenticate a user within a predetermined time period.

59. A computer readable medium as in claim 57, wherein the step of updating includes the step of:

replacing a biometric image in the database that has resulted in the least success in authentication and has the oldest time stamp.

60. A computer readable medium as in claim 56, further comprising the step of:

utilizing second authentication credentials independent of the first authentication credentials before updating the database.

61. A computer readable medium as in claim 53, further comprising the step of:

delaying the step of disabling if any activity is detected from a peripheral device.

62. A computer readable medium as in claim 53, wherein the peripheral device is at least one from the group of keyboard, mouse and touch screen.

63. A computer readable medium as in claim 53, wherein the electronic device is at least one from the group of personal computer, personal digital assistant (PDA), mobile telephone or gaming device.