Personal computing device control using face detection and recognition

• US 8,600,120 B2
• Filed: 03/06/2008
• Issued: 12/03/2013
• Est. Priority Date: 01/03/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Gonion, Jeff, Kerr, Duncan Robert
• Primary Examiner(s): TUCKER, WESLEY J
• Application Number:
  US12/074,985
• Publication Number:
  US 20090175509A1
• Time in Patent Office: 2,098 Days
• Field of Search: 382/118, 382/155, 382/181, 382/209, 382217-222
• US Class Current: 382/118
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 18/40 Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/629 to features or functions of an application
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06V 10/945 User interactive design; Environments; Toolboxes
• CPC Class Codes: G06V 40/16 Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/164 using holistic features
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Systems and methods are provided for control of a personal computing device based on user face detection and recognition techniques.

Claims

1. An electronic device comprising:

an imaging unit for acquiring at least one image;

a receiver for receiving at least one incoming communication from a remote source; and

a processor for;

analyzing the acquired at least one image to detect a face in response to the receiving the at least one incoming communication and not in response to the electronic device receiving an active user interaction from a user of the electronic device;

in response to the analyzing, determining whether the face is detected;

in response to a determination that the face is detected, performing a first action corresponding to the received at least one incoming communication; and

in response to a determination that the face is not detected, performing a second action corresponding to the received at least one incoming communication.

2. The device of claim 1, wherein the received at least one incoming communication comprises at least one of an incoming telephone call, an audio message, a video message, a multi-media message, an e-mail, a text message, and an instant message.

3. The device of claim 1, wherein the first action comprises displaying a visual notification.

4. The device of claim 3, wherein the first action does not comprise any one of outputting an audible notification and vibrating the device.

5. The device of claim 4, wherein the received at least one incoming communication comprises an incoming telephone call.

6. The device of claim 4, wherein the second action comprises at least one of outputting an audible notification and vibrating the device.

7. The device of claim 6, wherein the received at least one incoming communication comprises an incoming telephone call.

8. The device of claim 1, wherein the first action comprises determining whether the detected face belongs to an authorized user of the device.

9. The device of claim 8, wherein, in response to a determination that the detected face belongs to the authorized user of the device, the processor performs a third action, and wherein the third action comprises at least one of outputting an alert regarding the received at least one incoming communication and allowing access to content of the received at least one incoming communication.

10. The device of claim 8, wherein, in response to a determination that the detected face does not belong to the authorized user of the device, the processor performs a fourth action, and wherein the fourth action comprises restricting access to content of the received at least one incoming communication.

11. The device of claim 10, wherein the fourth action does not comprise any one of outputting an alert regarding the received at least one incoming communication and allowing access to content of the received at least one incoming communication.

23. The device of claim 1, wherein the first action is different from the second action.

24. The device of claim 1, wherein the remote source comprises an external device distinct from the electronic device.

25. The device of claim 1, wherein the second action comprises at least one of restricting access to content of the received at least one incoming communication and hiding the content of the received at least one incoming communication.

12. A method comprising:

acquiring at least one image with an electronic device;

receiving with the electronic device at least one incoming communication from a remote source;

analyzing the acquired at least one image to detect a face in response to the receiving the at least one incoming communication with the electronic device and not in response to the electronic device receiving an active user interaction from a user of the electronic device;

in response to the analyzing, determining whether the face is detected;

in response to a determination that the face is detected, performing a first action corresponding to the received at least one incoming communication with the electronic device; and

in response to a determination that the face is not detected, performing a second action corresponding to the received at least one incoming communication with the electronic device.

13. The method of claim 12, wherein the received at least one incoming communication comprises at least one of an incoming telephone call, an audio message, a video message, a multi-media message, an e-mail, a text message, and an instant message.

14. The method of claim 12, wherein the performing the first action comprises displaying a visual notification.

15. The method of claim 14, wherein the performing the first action does not comprise any one of outputting an audible notification and vibrating the device.

16. The method of claim 15, wherein the received at least one incoming communication comprises an incoming telephone call.

17. The method of claim 15, wherein the performing the second action comprises at least one of outputting an audible notification and vibrating the device.

18. The method of claim 17, wherein the received at least one incoming communication comprises an incoming telephone call.

19. The method of claim 12, wherein the first action comprises determining whether the detected face belongs to an authorized user of the electronic device.

20. The method of claim 19, wherein, in response to a determination that the detected face belongs to the authorized user of the electronic device, performing with the electronic device a third action, and wherein the third action comprises at least one of outputting an alert regarding the received at least one incoming communication and allowing access to content of the received at least one incoming communication.

21. The method of claim 19, wherein, in response to a determination that the detected face does not belong to the authorized user of the electronic device, performing with the electronic device a fourth action, and wherein the fourth action comprises restricting the received at least one incoming communication.

22. The method of claim 21, wherein the performing the fourth action does not comprise any one of outputting an alert regarding the received at least one incoming communication and allowing access to content of the received at least one incoming communication.

26. The method of claim 12, wherein the first action is different from the second action.

27. The method of claim 12, wherein the remote source comprises an external device distinct from the electronic device.

28. The method of claim 12, wherein the second action comprises at least one of restricting with the electronic device access to content of the received at least one incoming communication and hiding the content of the received at least one incoming communication.

29. A method comprising:

receiving with an electronic device at least one incoming communication that is not from a user of the electronic device;

in response to the receiving, attempting to detect with the electronic device a face;

in response to the attempting, determining whether the face is detected; and

in response to the determining, outputting with the electronic device an alert indicating that the at least one incoming communication has been received, wherein a type of the outputted alert is based on a result of the determining.

30. The method of claim 29, wherein the received at least one incoming communication comprises an incoming telephone call.

31. The method of claim 29, wherein, when the result of the determining is that the face is detected, the type of the outputted alert comprises a visual alert that is displayed on a display of the electronic device.

32. The method of claim 31, wherein, when the result of the determining is that the face is not detected, the type of the outputted alert comprises at least one of an audible alert and a vibrating alert.

33. The method of claim 29, wherein the received at least one incoming communication is received from an external device that is remote from the electronic device.

34. A method comprising:

receiving with an electronic device at least one incoming communication that is not from a user of the electronic device;

in response to the receiving, attempting to authorize with the electronic device a detected face;

in response to the attempting, determining whether the detected face is authorized; and

deciding with the electronic device whether to output an alert that the at least one incoming communication is received based on a result of the determining.

35. The method of claim 34, wherein the received at least one incoming communication comprises at least one of an audio message, a video message, a multi-media message, an e-mail, a text message, and an instant message.

36. The method of claim 34, wherein the deciding comprises deciding to output the alert when the result of the determining is that the detected face is authorized.

37. The method of claim 36 further comprising, in response to the electronic device deciding to output the alert, outputting the alert with the electronic device.

38. The method of claim 36, wherein the deciding comprises deciding not to output the alert when the result of the determining is that the detected face is not authorized.

39. The method of claim 34, wherein the received at least one incoming communication is received from an external device that is remote from the electronic device.