Methods, systems, and media for displaying information related to displayed content upon detection of user attention

• US 10,210,219 B2
• Filed: 12/15/2017
• Issued: 02/19/2019
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Liu, Eric H.
• Primary Examiner(s): Chbouki, Tarek
• Application Number:
  US15/843,483
• Publication Number:
  US 20180113868A1
• Time in Patent Office: 431 Days
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

Methods, systems, and media for displaying information related to displayed content upon detection of user attention are provided. In some implementations, a method for presenting information to a user is provided, the method comprising: detecting a presence of a user; retrieving content and associated content metadata; causing the content to be presented to the user in response to detecting the presence of the user; detecting a user action indicative of user attention to at least a portion of the content presented to the user; and in response to detecting the user action, causing information to be presented to the user, wherein the information presented to the user corresponds to the content metadata associated with the portion of the content.

Claims

1. A method for presenting information to a user, the method comprising:

detecting, using a hardware processor, a presence of a user;

in response to detecting the presence of the user, causing a presentation of consecutive content items to be presented to the user, via a display device, wherein the consecutive content items include a first content item and a second content item;

retrieving the first content item and associated first content metadata;

causing the first content item to be presented to the user, via the display device, during a first time period;

determining that user attention to the first content item has not been detected during the first time period;

retrieving the second content item and associated second content metadata;

causing the second content item to be presented to the user, via the display device, during a second time period;

determining that the user attention to the second content item during the second time period has been detected;

in response to determining that the user attention to the second content item during the second time period has been detected, determining supplemental content related to the second content item based on one or more keywords from the second metadata and pausing the presentation of consecutive content items; and

causing the supplemental content to be presented to the user concurrently with the second content item.

2. The method of claim 1, wherein providing the supplemental content further comprises causing the supplemental content to be presented via the display device.

3. The method of claim 1, wherein providing the supplemental content further comprises transmitting the supplemental content for presentation on a second device, wherein the second device is associated with the display device over a communication network.

4. The method of claim 1, wherein determining that the user attention to the second content item during the second time period has been detected further comprises determining that user actions indicative of the user attention have been maintained over a specified period of time.

5. The method of claim 1, wherein determining the user attention to the first content item and the second content item further comprises detecting at least a first angle of a body part of the user with respect to the display device and detecting the user attention to one of the first content item and the second content item based on the first angle of the body part of the user.

6. The method of claim 5, wherein detecting the first angle of the body part of the user with respect to the display device further comprises detecting that a face angle of the user is within a predetermined angle of the display device.

7. The method of claim 1, wherein determining the user attention to the first content item and the second content item further comprises detecting a movement of a body part of the user with respect to the display to a second angle and detecting the user attention to one of the first content item and the second content item based on the movement of the body part of the user to the second angle.

8. The method of claim 7, further comprising:

detecting a second movement of the body part of the user with respect to the display device in response to the supplemental content being presented to the user;

retrieving second supplemental content related to the supplemental content being presented to the user; and

causing the second supplemental content to be presented to the user in response to detecting the second movement.

9. The method of claim 8, wherein retrieving second supplemental content further comprises:

transmitting a search query for second supplemental content based on the supplemental content being presented to the user;

ranking search results responsive to the search query based on the supplemental content being presented to the user; and

selecting at least one search result from the search results to be provided to the user based on the ranking.

10. The method of claim 1, wherein the supplemental content includes popular information related to the second content item based on one or more keywords from the second metadata.

11. A system for presenting information to a user, the system comprising:

a hardware processor configured to;

detect a presence of a user;

in response to detecting the presence of the user, causing a presentation of consecutive content items to be presented to the user, via a display device, wherein the consecutive content items include a first content item and a second content item;

retrieving the first content item and associated first content metadata;

causing the first content item to be presented to the user, via the display device, during a first time period;

determining that user attention to the first content item has not been detected during the first time period;

retrieving the second content item and associated second content metadata;

causing the second content item to be presented to the user, via the display device, during a second time period;

determining that the user attention to the second content item during the second time period has been detected;

in response to determining that the user attention to the second content item during the second time period has been detected, determining supplemental content related to the second content item based on one or more keywords from the second metadata and pausing the presentation of consecutive content items; and

causing the supplemental content to be presented to the user concurrently with the second content item.

12. The system of claim 11, wherein providing the supplemental content further comprises causing the supplemental content to be presented via the display device.

13. The system of claim 11, wherein providing the supplemental content further comprises transmitting the supplemental content for presentation on a second device, wherein the second device is associated with the display device over a communication network.

14. The system of claim 11, wherein determining that the user attention to the second content item during the second time period has been detected further comprises determining that user actions indicative of the user attention have been maintained over a specified period of time.

15. The system of claim 11, wherein determining the user attention to the first content item and the second content item further comprises detecting at least a first angle of a body part of the user with respect to the display device and detecting the user attention to one of the first content item and the second content item based on the first angle of the body part of the user.

16. The system of claim 15, wherein detecting the first angle of the body part of the user with respect to the display device further comprises detecting that a face angle of the user is within a predetermined angle of the display device.

17. The system of claim 11, wherein determining the user attention to the first content item and the second content item further comprises detecting a movement of a body part of the user with respect to the display to a second angle and detecting the user attention to one of the first content item and the second content item based on the movement of the body part of the user to the second angle.

18. The system of claim 17, wherein the hardware processor is further configured to:

detect a second movement of the body part of the user with respect to the display device in response to the supplemental content being presented to the user;

retrieve second supplemental content related to the supplemental content being presented to the user; and

cause the second supplemental content to be presented to the user in response to detecting the second movement.

19. The system of claim 18, wherein retrieving second supplemental content further comprises:

transmitting a search query for second supplemental content based on the supplemental content being presented to the user;

ranking search results responsive to the search query based on the supplemental content being presented to the user; and

selecting at least one search result from the search results to be provided to the user based on the ranking.

20. The system of claim 11, wherein the supplemental content includes popular information related to the second content item based on one or more keywords from the second metadata.

21. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for presenting information to a user, the method comprising:

detecting a presence of a user;

in response to detecting the presence of the user, causing a presentation of consecutive content items to be presented to the user, via a display device, wherein the consecutive content items include a first content item and a second content item;

retrieving the first content item and associated first content metadata;

causing the first content item to be presented to the user, via the display device, during a first time period;

determining that user attention to the first content item has not been detected during the first time period;

retrieving the second content item and associated second content metadata;

causing the second content item to be presented to the user, via the display device, during a second time period;

determining that the user attention to the second content item during the second time period has been detected;

in response to determining that the user attention to the second content item during the second time period has been detected, determining supplemental content related to the second content item based on one or more keywords from the second metadata and pausing the presentation of consecutive content items; and

causing the supplemental content to be presented to the user concurrently with the second content item.