Reminders of media content referenced in other media content

• US 10,349,141 B2
• Filed: 11/19/2015
• Issued: 07/09/2019
• Est. Priority Date: 11/19/2015
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Trollope, Ingrid McAulay, Oztaskent, Ant, Volovich, Yaroslav
• Primary Examiner(s): Goodarzi, Nasser M
• Assistant Examiner(s): Ryan, Patrick A
• Application Number:
  US14/946,596
• Publication Number:
  US 20170150225A1
• Time in Patent Office: 1,328 Days
• CPC Class Codes: G06F 16/43 Querying
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44226 on social networks
• CPC Class Codes: H04N 21/47214 for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224

Abstract

A method at a computing system includes: receiving a request from a user; and in response to the user request: identifying a first media content item playing on a first client device concurrently with the user request, identifying a playback position in the first media content item temporally proximate to the user request, identifying a reference to an entity within a content portion of the first media content item, where the content portion corresponds to the identified playback position, identifying an event associated with the referenced entity, and setting a reminder of the event for the user.

Claims

1. A method, comprising:

at a server system having one or more processors and memory storing one or more programs for execution by the one or more processors;

receiving from a first device;

(i) a request from a user including a word or phrase communicated by the user indirectly referencing an entity; and

(ii) content information including one or more portions of audio and/or video components of a media program playing in proximity to the first device in response to the user request, the media program having originated from a third party content provider independent of the server system; and

in response to receiving the user request and the content information from the first device;

matching the content information received from the first device to a portion of content stored in a fingerprint database of the server system;

identifying the media program based on the matching;

identifying using the content information received from the first device a playback position in the identified media program within a predefined time period from the user request;

identifying the entity, consistent with the word or phrase, referenced by or included in a content portion of the identified media program, wherein the content portion corresponds to the identified playback position;

identifying an event associated with the entity consistent with the word or phrase; and

setting a reminder of the event for the user.

2. The method of claim 1, further comprising:

generating a presentation for display to the user, the presentation comprising respective indications of one or more of;

the first entity, and the event;

receiving a user response to the presentation;

in response to a determination that the user response to the presentation satisfies one or more predefined positive response criteria, setting the reminder of the event for the user; and

in response to a determination that the user response to the presentation does not satisfy the predefined positive response criteria, forgoing setting the reminder of the event.

3. The method of claim 1, wherein setting the reminder of the event for the user comprises:

automatically setting the reminder of the event for the user in accordance with one or more of;

one or more entity preferences of the user, and one or more event preferences of the user.

4. The method of claim 1, wherein the event is associated with a second media program.

5. The method of claim 1, wherein the event is a live event.

6. The method of claim 1, wherein the entity is the event.

7. The method of claim 1, wherein the entity is an entity distinct from the event and associated with the event.

8. The method of claim 1, wherein setting the reminder of the event for the user comprises adding the event to a watch list associated with the user.

9. The method of claim 1, wherein setting the reminder of the event for the user comprises generating a bookmark of the event.

10. The method of claim 1, wherein setting the reminder of the event for the user comprises generating a notification to the user for the event.

11. The method of claim 1, wherein the user request is received from a second client device distinct from the client device.

12. The method of claim 1, wherein identifying a media program comprises identifying the first media program based on one or more of:

metadata corresponding to the media program, subtitles data of the media program, a fingerprint of the media program, and a watermark of the media program.

13. The method of claim 1, wherein identifying a playback position in the media program comprises identifying the playback position based on one or more of:

metadata corresponding to the media program, subtitles data of the media program, a fingerprint of the media program, and a watermark of the media program.

14. The method of claim 1, wherein identifying the entity comprises identifying the reference to the entity based on one or more of:

subtitles data of the media program, optical character recognition of text in the media program, and speech-to-text conversion of speech in the media program.

15. The method of claim 1, wherein setting the reminder comprises:

determining availability of the event; and

setting the reminder of the event in accordance with the determined availability.

16. The method of claim 1, wherein:

the user request includes an indication of an event type; and

identifying an event associated with the entity comprises identifying the event in accordance with the indicated event type.

17. A server system, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

receiving from a first device;

(i) a request from a user including a word or phrase communicated by the user indirectly referencing an entity; and

(ii) content information including one or more portions of audio and/or video components of a media program playing in proximity to the first device in response to the user request, the media program having originated from a third party content provider independent of the server system; and

in response to receiving the user request and the content information from the first device;

matching the content information received from the first device to a portion of content stored in a fingerprint database of the server system;

identifying the media program based on the matching;

identifying using the content information received from the first device a playback position in the identified media program within a predefined time period from the user request;

identifying the entity, consistent with the word or phrase, referenced by or included in a content portion of the identified media program, wherein the content portion corresponds to the identified playback position;

identifying an event associated with the entity consistent with the word or phrase; and

setting a reminder of the event for the user.

18. The system of claim 17, further comprising instructions for:

generating a presentation for display to the user, the presentation comprising respective indications of one or more of;

the entity, and the event;

receiving a user response to the presentation;

in response to a determination that the user response to the presentation satisfies one or more predefined positive response criteria, setting the reminder of the event for the user; and

in response to a determination that the user response to the presentation does not satisfy the predefined positive response criteria, forgoing setting the reminder of the event.

19. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions which, when executed by a server system with one or more processors, cause the server system to:

receive from a first device;

(i) a request from a user including a word or phrase communicated by the user indirectly referencing an entity; and

(ii) content information including one or more portions of audio and/or video components of a media program playing in proximity to the first device in response to the user request, the media program having originated from a third party content provider independent of the server system; and

in response to receiving the user request and the content information from the first device;

match the content information received from the first device to a portion of content stored in a fingerprint database of the server system;

identify the media program based on the matching;

identify using the content information received from the first device a playback position in the identified media program within a predefined time period from the user request;

identify the entity, consistent with the word or phrase, referenced by or included in a content portion of the identified media program, wherein the content portion corresponds to the identified playback position;

identify an event associated with the entity consistent with the word or phrase; and

set a reminder of the event for the user.

20. The computer readable storage medium of claim 19, further comprising instructions which, when executed by the server system, cause the server system to:

generate a presentation for display to the user, the presentation comprising respective indications of one or more of;

the entity, and the event;

receive a user response to the presentation;

in response to a determination that the user response to the presentation satisfies one or more predefined positive response criteria, set the reminder of the event for the user; and

in response to a determination that the user response to the presentation does not satisfy the predefined positive response criteria, forgo setting the reminder of the event.