Image analysis and communication device control technology
First Claim
1. A smart phone comprising:
- a speaker configured to provide audible output;
a display screen configured to provide display output;
an image capture device configured to capture images of an area in front of the display screen such that the image capture device is oriented to capture images of an area in which a user is in position to perceive the display screen; and
at least one processor configured to control operation of the speaker, the display screen, and the image capture device, the at least one processor being configured to perform operations comprising;
controlling the speaker to initiate audible output and controlling the display screen to initiate visual output associated with the audible output from the speaker;
while providing the audible output through the speaker and the visual output through the display screen;
controlling the image capture device to capture one or more images of the area in front of the display screen;
analyzing the one or more images for a user in a position in front of the display screen;
based on the analysis of the one or more images for a user in a position in front of the display screen, detecting a person within the one or more images of the area in front of the display screen;
based on detecting the person in the one or more images of the area in front of the display screen, analyzing the one or more images of the area in front of the display screen to determine whether the person is looking at the display screen;
based on the analysis of the one or more images of the area in front of the display screen to determine whether the person is looking at the display screen, determining whether the person is looking at the display screen; and
automatically, without human intervention, controlling further handling of the audible output through the speaker and the visual output through the display screen in accordance with the determination of whether the person is looking at the display screen,wherein automatically, without human intervention, controlling further handling of the audible output through the speaker and the visual output through the display screen in accordance with the determination of whether the person is looking at the display screen comprises, in response to a determination that the person is not looking at the display screen, automatically, without human intervention, adjusting the audible output through the speaker and the visual output through the display screen in a manner suitable for a person that is not looking at the display screen.
3 Assignments
0 Petitions
Accused Products
Abstract
Techniques are described for controlling communication devices using image analysis. For instance, when a communication is received by a communication device, the communication device outputs an alert to notify users of the received communication and accesses one or more images of an area proximate to the communication device. The one or more images cover an area proximate to the communication device at a time during which the communication device is outputting the alert. The communication device analyzes the one or more images to determine whether a user is present in the one or more images and in a position to perceive the received communication. The communication device handles at least one aspect of the received communication based on the determination of whether a user is in a position to perceive the received communication.
-
Citations
20 Claims
-
1. A smart phone comprising:
-
a speaker configured to provide audible output; a display screen configured to provide display output; an image capture device configured to capture images of an area in front of the display screen such that the image capture device is oriented to capture images of an area in which a user is in position to perceive the display screen; and at least one processor configured to control operation of the speaker, the display screen, and the image capture device, the at least one processor being configured to perform operations comprising; controlling the speaker to initiate audible output and controlling the display screen to initiate visual output associated with the audible output from the speaker; while providing the audible output through the speaker and the visual output through the display screen; controlling the image capture device to capture one or more images of the area in front of the display screen; analyzing the one or more images for a user in a position in front of the display screen; based on the analysis of the one or more images for a user in a position in front of the display screen, detecting a person within the one or more images of the area in front of the display screen; based on detecting the person in the one or more images of the area in front of the display screen, analyzing the one or more images of the area in front of the display screen to determine whether the person is looking at the display screen; based on the analysis of the one or more images of the area in front of the display screen to determine whether the person is looking at the display screen, determining whether the person is looking at the display screen; and automatically, without human intervention, controlling further handling of the audible output through the speaker and the visual output through the display screen in accordance with the determination of whether the person is looking at the display screen, wherein automatically, without human intervention, controlling further handling of the audible output through the speaker and the visual output through the display screen in accordance with the determination of whether the person is looking at the display screen comprises, in response to a determination that the person is not looking at the display screen, automatically, without human intervention, adjusting the audible output through the speaker and the visual output through the display screen in a manner suitable for a person that is not looking at the display screen. - View Dependent Claims (2, 3)
-
-
4. A mobile device comprising:
-
a display screen configured to provide display output; an image capture device configured to capture images of an area in front of the display screen such that the image capture device is oriented to capture images of an area in which a user is in position to perceive the display screen; at least one processor configured to control operation of the display screen and the image capture device, the at least one processor being configured to perform operations comprising; controlling the image capture device to capture one or more images of the area in front of the display screen; analyzing the one or more images of the area in front of the display screen for a user in a position that enables perception of the display screen; based on the analysis of the one or more images of the area in front of the display screen for a user in a position that enables perception of the display screen, determining whether a user is in a position that enables perception of the display screen; based on a determination that a user is in a position that enables perception of the display screen, automatically, without human intervention, updating output of the display screen to display additional information that was not displayed by the display screen; and based on a determination that a user is not in a position that enables perception of the display screen, maintaining output of the display screen without displaying the additional information, wherein controlling the image capture device to capture one or more images of the area in front of the display screen comprises controlling the image capture device to begin capturing images in response to user manipulation of the mobile device. - View Dependent Claims (5, 6, 7, 8, 9, 10, 11)
-
-
12. A communication device comprising:
-
a display screen configured to provide display output; an image capture device configured to capture images of an area in front of the display screen such that the image capture device is oriented to capture images of an area in which a user is in position to perceive the display screen; and at least one processor configured to control operation of the display screen and the image capture device, the at least one processor being configured to perform operations comprising; controlling the image capture device to capture one or more images of the area in front of the display screen; analyzing the one or more images of the area in front of the display screen for a user in a position that enables perception of the display screen; based on the analysis of the one or more images of the area in front of the display screen for a user in a position that enables perception of the display screen, determining whether a user is in a position that enables perception of the display screen; based on a determination that a user is in a position that enables perception of the display screen, automatically, without human intervention, maintaining the display screen in an on state in which information is displayed; and based on a determination that a user is not in a position that enables perception of the display screen, automatically, without human intervention, controlling the display screen to change to a blank or an off state. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20)
-
Specification