Image analysis and communication device control technology

• US 8,538,158 B1
• Filed: 02/19/2012
• Issued: 09/17/2013
• Est. Priority Date: 09/29/2009
• Status: Active Grant

• Current Assignee: Uber Technologies, Inc.
• Original Assignee: Jason Adam Denise
• Inventors: Denise, Jason Adam
• Primary Examiner(s): BEKELE, MEKONEN T
• Application Number:
  US13/400,091
• Time in Patent Office: 576 Days
• Field of Search: 379/265.01, 379/265.02, 379/265.11, 379/202.01, 379/142.01, 379/142.04, 379/142.06, 348/140.1, 348/14.08, 348/14.07, 455/426.1, 455/414.1, 455/445, 455/461, 455/556.1, 382/199, 382/190, 382/195, 382/100
• US Class Current: 382/190
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 1/72463 to restrict the functionality of the device
• CPC Class Codes: H04M 1/724631 by limiting the access to the user interface, e.g. locking a touch-screen or a keypad
• CPC Class Codes: H04M 1/72484 wherein functions are triggered by incoming communication events
• CPC Class Codes: H04M 19/04 the ringing-current being generated at the substations
• CPC Class Codes: H04M 2250/52 including functional features of a camera constructional features concerning the integration of cameras in portable phones H04M1/0264
• CPC Class Codes: H04M 3/02 Calling substations, e.g. by ringing selective calling H04Q
• CPC Class Codes: H04W 4/12 Messaging; Mailboxes; Announcements

Abstract

Techniques are described for controlling communication devices using image analysis. For instance, when a communication is received by a communication device, the communication device outputs an alert to notify users of the received communication and accesses one or more images of an area proximate to the communication device. The one or more images cover an area proximate to the communication device at a time during which the communication device is outputting the alert. The communication device analyzes the one or more images to determine whether a user is present in the one or more images and in a position to perceive the received communication. The communication device handles at least one aspect of the received communication based on the determination of whether a user is in a position to perceive the received communication.

Claims

1. A method of using image analysis to control an electronic communication device, the method comprising:

receiving, at an electronic communication device, an incoming electronic communication for a recipient;

capturing, using at least one image capture device, one or more images of an area proximate to the electronic communication device;

based on receipt of the incoming electronic communication by the electronic communication device, analyzing, using at least one processing device, the one or more captured images to determine whether a face is present within the one or more captured images;

in response to a determination that a face is not present within the one or more captured images, handling the incoming electronic communication as not being perceived by the recipient;

in response to a determination that a face is present within the one or more captured images;

detecting the face within the one or more captured images;

determining whether an identity of the face detected within the one or more captured images is known or unknown;

in response to a determination that the identity of the face detected within the one or more captured images is unknown, handling the incoming electronic communication as being perceived by an unknown recipient; and

in response to a determination that the identity of the face detected within the one or more captured images is known;

accessing, from electronic storage, personalized electronic communication handling settings for the identified recipient, and

handling the incoming electronic communication based on the personalized electronic communication handling settings for the identified recipient.

2. The method of claim 1, wherein handling the incoming electronic communication as not being perceived by the recipient comprises determining that the recipient missed the incoming electronic communication because a face was not detected and handling the incoming electronic communication as a missed electronic communication.

3. The method of claim 1, wherein handling the incoming electronic communication as not being perceived by the recipient comprises controlling output that alerts users to receipt of the incoming electronic communication in response to the determination that a face is not present within the one or more captured images.

4. The method of claim 3, wherein controlling output that alerts users to receipt of the incoming electronic communication in response to the determination that a face is not present within the one or more captured images comprises increasing a volume of an audible alert signaling receipt of the incoming electronic communication in response to the determination that a face is not present within the one or more captured images.

5. The method of claim 1, wherein handling the incoming electronic communication as being perceived by the unknown recipient comprises preventing the unknown recipient from using the electronic communication device.

6. The method of claim 1, wherein handling the incoming electronic communication as being perceived by the unknown recipient comprises allowing the unknown recipient to handle the incoming electronic communication being received and preventing the unknown recipient from accessing messages and past communications.

7. The method of claim 1, wherein handling the incoming electronic communication as being perceived by the unknown recipient comprises allowing the unknown recipient to handle incoming phone calls, but preventing the unknown recipient from handling incoming electronic mail messages.

8. The method of claim 1, wherein handling the incoming electronic communication as being perceived by the unknown recipient comprises displaying a notification that a call was received on the electronic communication device and was answered by an unknown recipient.

9. The method of claim 1, wherein handling the incoming electronic communication based on the personalized electronic communication handling settings for the identified recipient comprises handling the incoming electronic communication based on personalized electronic communication handling settings related to at least one of ringer volume, vibration settings, and display settings.

10. The method of claim 1, wherein handling the incoming electronic communication based on the personalized electronic communication handling settings for the identified recipient comprises displaying a first set of information related to the incoming electronic communication for a first identified recipient, displaying a second set of information related to the incoming electronic communication for a second identified recipient, and maintaining a blank display for a third identified recipient, the first, second, and third identified recipients being different recipients.

11. The method of claim 1, wherein handling the incoming electronic communication based on the personalized electronic communication handling settings for the identified recipient comprises controlling communication alerts and displayed information based on the personalized electronic communication handling settings for the identified recipient.

12. The method of claim 1, wherein handling the incoming electronic communication based on the personalized electronic communication handling settings for the identified recipient comprises listing an unanswered phone call as a missed call for a first identified recipient, listing an unanswered phone call as an ignored call for a second identified recipient, and determining not to list an unanswered phone call for a third identified recipient, the first, second, and third identified recipients being different recipients.

13. The method of claim 1, wherein handling the incoming electronic communication based on the personalized electronic communication handling settings for the identified recipient comprises providing a missed communication alert for a first identified recipient, providing an ignored communication alert which is different than the missed communication alert for a second identified recipient, and withholding an unanswered or unopened communication alert for a third identified recipient, the first, second, and third identified recipients being different recipients.

14. The method of claim 1, wherein handling the incoming electronic communication based on the personalized electronic communication handling settings for the identified recipient comprises preventing a first identified recipient from handling any type of electronic communication, allowing a second identified recipient to handle an incoming phone call, but preventing the second identified recipient from handling an incoming electronic mail message, and allowing a third identified recipient to handle any type of communication, the first, second, and third identified recipients being different recipients.

15. The method of claim 1, wherein handling the incoming electronic communication based on the personalized electronic communication handling settings for the identified recipient comprises automatically controlling volume settings and display settings based on the personalized electronic communication handling settings for the identified recipient.

16. The method of claim 1, further comprising tracking data related to which users are handling which communications and displaying information related to the tracked data, the displaying including displaying, in a list of communications, information that indicates which user received, ignored, or placed the corresponding communication in the list.

17. The method of claim 1, further comprising, for an alert related to an incoming communication, providing information indicating which recipient ignored the incoming communication in the alert and tailoring the alert based on which recipient ignored the incoming communication.

18. The method of claim 1, wherein tailoring the alert based on which recipient ignored the incoming communication comprises withholding the alert when the recipient that ignored the incoming communication is using the communication device, but providing a missed communication alert when another user is using the communication device.

19. The method of claim 1, wherein handling the incoming electronic communication based on the personalized electronic communication handling settings for the identified recipient comprises providing an alert indicating that the incoming electronic communication was missed, providing details related to the incoming electronic communication, and indicating that the incoming electronic communication was ignored by a first recipient.

20. An electronic communication device comprising:

at least one image capture device; and

at least one processing device configured to perform operations comprising;

receiving an incoming electronic communication for a recipient;

capturing, using the at least one image capture device, one or more images of an area proximate to the electronic communication device;

based on receipt of the incoming electronic communication, analyzing the one or more captured images to determine whether a face is present within the one or more captured images;

in response to a determination that a face is not present within the one or more captured images, handling the incoming electronic communication as not being perceived by the recipient;

in response to a determination that a face is present within the one or more captured images;

detecting the face within the one or more captured images;

determining whether an identity of the face detected within the one or more captured images is known or unknown;

in response to a determination that the identity of the face detected within the one or more captured images is unknown, handling the incoming electronic communication as being perceived by an unknown recipient; and

in response to a determination that the identity of the face detected within the one or more captured images is known;

accessing, from electronic storage, personalized electronic communication handling settings for the identified recipient, and

handling the incoming electronic communication based on the personalized electronic communication handling settings for the identified recipient.