Displaying Information Related to Spoken Dialogue in Content Playing on a Device

• US 20150370864A1
• Filed: 06/20/2014
• Published: 12/24/2015
• Est. Priority Date: 06/20/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Oztaskent, Ant, Volovich, Yaroslav, Trollope, Ingrid McAulay
• Granted Patent: US 9,946,769 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/438 Presentation of query results
• CPC Class Codes: G06F 16/60 of audio data
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 16/7844 using original textual content or text extracted from visual content or transcript of audio data
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program

Abstract

A method at a server includes identifying a media content item currently being presented in proximity to a first user; identifying, in an entities repository, one or more first quotations associated with the media content item, where the first quotations are determined to be popular in accordance with one or more popularity criteria; sending, to a client device associated with the first user, the first quotations and one or more affordances associated with the first quotations; receiving selection of a first affordance of the affordances, the first affordance associated with a respective quotation of the first quotations; and in accordance with the selection of the first affordance, performing an operation associated with the respective quotation.

Claims

1. A method, comprising:

at a server;

identifying a media content item currently being presented in proximity to a first user;

identifying, in an entities repository, one or more first quotations associated with the media content item, wherein the first quotations are determined to be popular in accordance with one or more popularity criteria;

sending, to a client device associated with the first user, the first quotations and one or more affordances associated with the first quotations;

receiving selection of a first affordance of the affordances, the first affordance associated with a respective quotation of the first quotations; and

in accordance with the selection of the first affordance, performing an operation associated with the respective quotation.

2. The method of claim 1, wherein each respective affordance provides one or more options for interacting with a respective one of the first quotations.

3. The method of claim 1, wherein performing an operation associated with the respective quotation comprises any of:

sending to a client device information related to the respective quotation for display at the client device;

sharing the respective quotation;

sending to a client device a media snippet that includes the respective quotation for display at the client device;

initiating a search having the respective quotation as a search query;

initiating a search for an entity related to the respective quotation;

providing to a client device a text entry interface configured to receive input of a comment on the respective quotation;

or sharing an indication of interest in the media content item, the indication of interest including the respective quotation as a caption.

4. The method of claim 1, wherein the popularity criteria comprise one or more of:

a search query volume of a respective quotation by the first user, an aggregate search query volume of the respective quotation, a number of mentions of the respective quotation in social networks, and a number of documents of predefined categories that include the respective quotation.

5. The method of claim 1, wherein the popularity criteria comprise one or more realtime criteria.

6. The method of claim 5, wherein the first quotations are determined to be popular in realtime in accordance with the popularity criteria.

7. The method of claim 1, wherein identifying the media content item currently being presented in proximity to the first user comprises determining a portion of the media content item being presented in proximity to the first user.

8. The method of claim 7, wherein the first quotations are, within the media content item, proximate to the portion of the media content item being presented in proximity to the first user.

9. The method of claim 7, further comprising:

identifying one or more second quotations associated with a portion of the media content item succeeding the portion being presented in proximity to the first user;

detecting presentation of the succeeding portion in proximity to the first user; and

in accordance with the detection of the presentation of the succeeding portion, sending to the client device associated with the first user the second quotations and one or more affordances associated with the second quotations.

10. A method, comprising:

at a server;

identifying, from a plurality of documents, a plurality of quotations associated with media content;

identifying respective media content items associated with the quotations;

determining respective popularity metrics of the quotations in accordance with one or more popularity criteria; and

storing, in an entities repository;

associations between respective quotations and respective media content items; and

the respective popularity metrics of the quotations.

11. The method of claim 10, wherein identifying respective media content items associated with the quotations comprises matching the quotations to caption data associated with the respective media content items.

12. The method of claim 10, further comprising:

storing, in the entities repository, for a respective media content item;

associations between one or more entities associated with the media content item and a respective quotation associated with the respective media content item.

13. The method of claim 10, wherein the popularity criteria comprise one or more of:

a search query volume of a respective quotation, a number of mentions of the respective quotation in social networks, and a number of documents that include the respective quotation.

14. A method, comprising:

at a client device;

detecting a media content item currently presented in proximity to a first user;

displaying one or more popular quotations associated with the media content item and one or more corresponding affordances, wherein each of the affordances provides one or more options for interacting with a respective one of the popular quotations;

receiving user activation of a first affordance corresponding to a respective popular quotation; and

in accordance with the activation of the first affordance, performing an operation associated with the respective popular quotation.

15. The method of claim 14, wherein performing an operation associated with the respective popular quotation comprises any of:

displaying information related to the respective popular quotation;

sharing the respective popular quotation;

displaying a media snippet that includes the respective popular quotation;

initiating a search having the respective popular quotation as a search query;

initiating a search for an entity related to the respective popular quotation;

displaying a text entry interface configured to receive input of a comment on the respective popular quotation;

or sharing an indication of interest in the media content item, the indication of interest including the respective popular quotation as a caption.