Methods, systems, and media for displaying information related to displayed content upon detection of user attention

• US 9,881,058 B1
• Filed: 03/14/2013
• Issued: 01/30/2018
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Liu, Eric H.
• Primary Examiner(s): Chbouki, Tarek
• Application Number:
  US13/830,621
• Time in Patent Office: 1,783 Days
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

Methods, systems, and media for displaying information related to displayed content upon detection of user attention are provided. In some implementations, a method for presenting information to a user is provided, the method comprising: detecting a presence of a user; retrieving content and associated content metadata; causing the content to be presented to the user in response to detecting the presence of the user; detecting a user action indicative of user attention to at least a portion of the content presented to the user; and in response to detecting the user action, causing information to be presented to the user, wherein the information presented to the user corresponds to the content metadata associated with the portion of the content.

Claims

1. A method for presenting information to a user, the method comprising:

detecting, using a hardware processor, a presence of a user;

in response to detecting the presence of the user, causing a presentation of consecutive images to be presented to the user, via a display device, wherein the consecutive images include a first image and a second image;

retrieving the first image and associated first image metadata;

causing the first image to be presented to the user, via the display device, during a first time period;

detecting at least a first angle of a user'"'"'s body part with respect to the display device during the first time period;

determining, based at least in part on the first angle of the user'"'"'s body part, that the user'"'"'s attention is not directed to the first image during the first time period;

retrieving a second image and associated second image metadata;

causing the second image to be presented to the user, via the display device, during a second time period;

detecting a movement of the user'"'"'s body part with respect to the display device to a second angle;

determining, based at least in part on the movement to the second angle, that the user'"'"'s attention is directed to at least a portion of the second image;

in response to determining that the user'"'"'s attention is directed to at least the portion of the second image, determining popular information related to the second image based on one or more keywords from the second image metadata and pausing the presentation of consecutive images; and

causing the determined popular information to be presented to the user concurrently with the second image.

2. The method of claim 1, further comprising:

detecting a second movement of the user'"'"'s body part with respect to the display device in response to the information being presented to the user;

retrieving supplemental information related to the determined popular information; and

providing the supplemental information to the user in response to detecting the second movement.

3. The method of claim 2, wherein providing the supplemental information further comprises causing the supplemental information to be presented via the display device.

4. The method of claim 2, wherein providing the supplemental information further comprises transmitting the supplemental information to a second device.

5. The method of claim 2, wherein retrieving supplemental information further comprises:

transmitting a search query for supplemental content based on the determined popular information;

ranking search results responsive to the search query based on the determined popular information; and

selecting a particular search result from the search results to be provided to the user based on the ranking.

6. The method of claim 2, wherein the supplemental information includes at least one of:

a web page related to the determined popular information;

an advertisement related to the determined popular information;

a source of the content; and

search results related to the determined popular information.

7. The method of claim 1, wherein detecting the movement of a user'"'"'s body part further comprises detecting that a face angle of the user is within a predetermined angle of a display used for presenting the content.

8. The method of claim 1, wherein determining that the user'"'"'s attention is directed to at least the portion of the second image further comprises determining that the user'"'"'s attention is maintained over a specified period of time.

9. A system for presenting information to a user, the system comprising:

a hardware processor configured to;

detect a presence of a user;

in response to detecting the presence of the user, cause a presentation of consecutive images to be presented to the user, via a display device, wherein the consecutive images include a first image and a second image;

retrieve the first image and associated first image metadata;

cause the first image to be presented to the user, via the display device, during a first time period;

detect at least a first angle of a user'"'"'s body part with respect to the display device during the first time period;

determine, based at least in part on the first angle of the user'"'"'s body part, that the user'"'"'s attention is not directed to the first image during the first time period;

retrieve a second image and associated second image metadata;

cause the second image to be presented to the user, via the display device, during a second time period;

detect a movement of the user'"'"'s body part with respect to the display device to a second angle;

determine, based at least in part on the movement to the second angle, that the user'"'"'s attention is directed to at least a portion of the second image; and

in response to determining that the user'"'"'s attention is directed to at least the portion of the second image, determining popular information related to the second image based on one or more keywords from the second image metadata and pausing the presentation of consecutive images; and

cause the determined popular information to be presented to the user concurrently with the second image.

10. The system of claim 9, wherein the hardware processor is further configured to:

detect a second movement of the user'"'"'s body part with respect to the display device in response to the information being presented to the user;

retrieve supplemental information related to the determined popular information; and

provide the supplemental information to the user in response to detecting the second movement.

11. The system of claim 10, wherein the hardware processor is further configured to cause the supplemental information to be presented via the display device.

12. The system of claim 10, wherein the hardware processor is further configured to transmit the supplemental information to a second device.

13. The system of claim 10, wherein the hardware processor is further configured to:

transmit a search query for supplemental content based on the determined popular information;

rank search results responsive to the search query based on the determined popular information; and

select a particular search result from the search results to be provided to the user based on the ranking.

14. The system of claim 10, wherein the supplemental information includes at least one of:

a web page related to the determined popular information;

an advertisement related to the determined popular information;

a source of the content; and

search results related to the determined popular information.

15. The system of claim 9, wherein detecting the movement of a user'"'"'s body part further comprises detecting that a face angle of the user is within a predetermined angle of a display used for presenting the content.

16. The system of claim 9, wherein determining that the user'"'"'s attention is directed to at least the portion of the second image further comprises determining that the user'"'"'s attention is maintained over a specified period of time.

17. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for presenting information to a user, the method comprising:

detecting a presence of a user;

in response to detecting the presence of the user, causing a presentation of consecutive images to be presented to the user, via a display device, wherein the consecutive images include a first image and a second image;

retrieving the first image and associated first image metadata;

causing the first image to be presented to the user, via the display device, during a first time period;

detecting at least a first angle of a user'"'"'s body part with respect to the display device during the first time period;

determining, based at least in part on the first angle of the user'"'"'s body part, that the user'"'"'s attention is not directed to the first image during the first time period;

retrieving a second image and associated second image metadata;

causing the second image to be presented to the user, via the display device, during a second time period;

detecting movement of the user'"'"'s body part with respect to the display device to a second angle;

determining, based at least in part on the movement to the second angle, that the user'"'"'s attention is directed to at least a portion of the second image;

in response to determining that the user'"'"'s attention is directed to at least the portion of the second image, determining popular information related to the second image based on one or more keywords from the second image metadata and pausing the presentation of consecutive images; and

causing the determined popular information to be presented to the user concurrently with the second image.

18. The non-transitory computer-readable medium of claim 17, wherein the method further comprises:

detecting a second movement of the user'"'"'s body part with respect to the display device in response to the information being presented to the user;

retrieving supplemental information related to the determined popular information; and

providing the supplemental information to the user in response to detecting the second movement.

19. The non-transitory computer-readable medium of claim 18, wherein providing the supplemental information further comprises causing the supplemental information to be presented via the display device.

20. The non-transitory computer-readable medium of claim 19, wherein providing the supplemental information further comprises transmitting the supplemental information to a second device.

21. The non-transitory computer-readable medium of claim 18, wherein retrieving supplemental information further comprises:

transmitting a search query for supplemental content based on the determined popular information;

ranking search results responsive to the search query based on the determined popular information; and

selecting a particular search result from the search results to be provided to the user based on the ranking.

22. The non-transitory computer-readable medium of claim 18, wherein the supplemental information includes at least one of:

a web page related to the determined popular information;

an advertisement related to the determined popular information;

a source of the content; and

search results related to the determined popular information.

23. The non-transitory computer-readable medium of claim 17, wherein detecting the movement of a user'"'"'s body part further comprises detecting that a face angle of the user is within a predetermined angle of a display used for presenting the content.

24. The non-transitory computer-readable medium of claim 17, wherein determining that the user'"'"'s attention is directed to at least the portion of the second image further comprises determining that the user'"'"'s attention is maintained over a specified period of time.