Methods, systems, and media for presenting supplemental content relating to media content based on state information that indicates a subsequent visit to the content interface

• US 9,913,000 B2
• Filed: 11/07/2016
• Issued: 03/06/2018
• Est. Priority Date: 12/31/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Trollope, Ingrid McAulay, Oztaskent, Ant, Volovich, Yaroslav
• Primary Examiner(s): NGUYEN BA, HOANG VU A
• Application Number:
  US15/345,342
• Publication Number:
  US 20170055044A1
• Time in Patent Office: 484 Days
• Field of Search: None
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: G10L 19/018 Audio watermarking, i.e. embedding inaudible data in the audio signal
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 1/32776 using an interactive, user-operated device, e.g. a computer terminal, mobile telephone H04N1/32782, H04N1/32784 take precedence
• CPC Class Codes: H04N 1/32782 using a tone- or pulse-coded request
• CPC Class Codes: H04N 1/32784 using a voice request
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/436 Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4755 for defining user preferences, e.g. favourite actors or genre retrieval personalisation and generation of user profiles for the retrieval of video data G06F16/739; user profiles in network data switching protocols H04L67/306
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/8405 represented by keywords

Abstract

In accordance with some implementations of the disclosed subject matter, mechanisms for presenting recommended media content items are provided. In some implementations, a method for providing media guidance is provided, the method comprising: receiving a request for supplemental content relating to a program being presented by a media device; causing a content interface to be presented on a mobile device; identifying the program that is being presented on a media device; determining keywords associated with the program, wherein each of the keywords is associated with a particular portion of the program; obtaining and storing supplemental content items corresponding to the program based on the keywords; causing the content interface to present a first supplemental content item; receiving state information associated with the mobile device that indicates a subsequent visit to the content interface; and causing the content interface to present a second supplemental content item based on the state information.

Claims

1. A method for providing media guidance, the method comprising:

receiving, using a hardware processor, a request for supplemental content relating to a media content item being presented by a media device;

causing a content interface to be presented on a mobile device in response to receiving the request;

identifying the media content item that is being presented on a media device;

obtaining and storing a plurality of supplemental content items corresponding to the media content item;

causing the content interface to present a first supplemental content item from the plurality of supplemental content items;

receiving state information associated with the mobile device that indicates a subsequent visit to the content interface;

determining that the state information comprises an indication that the mobile device returned from a display inhibited state in which presentation of the content interface was inhibited; and

causing the content interface to present a second supplemental content item from the plurality of supplemental content items that relates to the media content item that was identified as being presented on the media device based on the determination.

2. The method of claim 1, further comprising causing the content interface to be presented in response to detecting the presence of the media device on a local area network, wherein the media device and the mobile device are connected to the local area network.

3. The method of claim 1, wherein receiving the request further comprises receiving an audio fingerprint of audio information corresponding to the media content item being presented on the media device, wherein the media content item is identified based on the audio fingerprint.

4. The method of claim 1, wherein receiving the request further comprises:

extracting an audio stream from a plurality of media content items;

generating, for each of the plurality of media content items, at least one audio fingerprint from at least a portion of the extracted audio stream that corresponds to one of the plurality of media content items;

storing the at least one audio fingerprint in a data source indexed by media content item;

comparing the audio fingerprint with the at least one stored audio fingerprint; and

identifying the media content item that is being presented on the media device based on the comparison.

5. The method of claim 1, further comprising:

storing the plurality of supplemental content items, media information, and a plurality of keywords in a data source indexed by media content item and time within the media content item;

selecting the first supplemental content item from the data source based on a first time determined from the request; and

selecting the second supplemental content item from the data source based on a second time determined from the state information.

6. The method of claim 1, wherein the second supplemental content item is caused to be presented in response to determining that the state information was received prior to the end of the media content item and in response to determining that the state information was received within a predetermined time from the presentation of the content interface.

7. A system for providing media guidance, the system comprising:

a hardware processor that is configured to;

receive a request for supplemental content relating to a media content item being presented by a media device;

cause a content interface to be presented on a mobile device in response to receiving the request;

identify the media content item that is being presented on a media device;

obtain and storing a plurality of supplemental content items corresponding to the media content item;

cause the content interface to present a first supplemental content item from the plurality of supplemental content items;

receive state information associated with the mobile device that indicates a subsequent visit to the content interface;

determine that the state information comprises an indication that the mobile device returned from a display inhibited state in which presentation of the content interface was inhibited; and

cause the content interface to present a second supplemental content item from the plurality of supplemental content items that relates to the media content item that was identified as being presented on the media device based on the determination.

8. The system of claim 7, wherein the hardware processor is further configured to cause the content interface to be presented in response to detecting the presence of the media device on a local area network, wherein the media device and the mobile device are connected to the local area network.

9. The system of claim 7, wherein the hardware processor is further configured to receive an audio fingerprint of audio information corresponding to the media content item being presented on the media device, wherein the media content item is identified based on the audio fingerprint.

10. The system of claim 7, wherein the hardware processor is further configured to:

extract an audio stream from a plurality of media content items;

generate, for each of the plurality of media content items, at least one audio fingerprint from at least a portion of the extracted audio stream that corresponds to one of the plurality of media content items;

store the at least one audio fingerprint in a data source indexed by media content item;

compare the audio fingerprint with the at least one stored audio fingerprint; and

identify the media content item that is being presented on the media device based on the comparison.

11. The system of claim 7, wherein the hardware processor is further configured to:

store the plurality of supplemental content items, media information, and a plurality of keywords in a data source indexed by media content item and time within the media content item;

select the first supplemental content item from the data source based on a first time determined from the request; and

select the second supplemental content item from the data source based on a second time determined from the state information.

12. The system of claim 7, wherein the hardware processor is further configured to cause the second supplemental content item to be presented in response to determining that the state information was received prior to the end of the program and in response to determining that the state information was received within a predetermined time from the presentation of the content interface.

13. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for providing media guidance, the method comprising:

receiving a request for supplemental content relating to a media content item being presented by a media device;

causing a content interface to be presented on a mobile device in response to receiving the request;

identifying the media content item that is being presented on a media device;

obtaining and storing a plurality of supplemental content items corresponding to the media content item;

causing the content interface to present a first supplemental content item from the plurality of supplemental content items;

receiving state information associated with the mobile device that indicates a subsequent visit to the content interface;

determining that the state information comprises an indication that the mobile device returned from a display inhibited state in which presentation of the content interface was inhibited; and

causing the content interface to present a second supplemental content item from the plurality of supplemental content items that relates to the media content item that was identified as being presented on the media device based on the determination.

14. The non-transitory computer-readable medium of claim 13, wherein the method further comprises causing the content interface to be presented in response to detecting the presence of the media device on a local area network, wherein the media device and the mobile device are connected to the local area network.

15. The non-transitory computer-readable medium of claim 13, wherein the method further comprises receiving an audio fingerprint of audio information corresponding to the media content item being presented on the media device, wherein the media content item is identified based on the audio fingerprint.

16. The non-transitory computer-readable medium of claim 13, wherein the method further comprises:

extracting an audio stream from a plurality of media content items;

generating, for each of the plurality of media content items, at least one audio fingerprint from at least a portion of the extracted audio stream that corresponds to one of the plurality of media content items;

storing the at least one audio fingerprint in a data source indexed by media content item;

comparing the audio fingerprint with the at least one stored audio fingerprint; and

identifying the media content item that is being presented on the media device based on the comparison.

17. The non-transitory computer-readable medium of claim 13, wherein the method further comprises:

storing the plurality of supplemental content items, media information, and a plurality of keywords in a data source indexed by media content item and time within the media content item;

selecting the first supplemental content item from the data source based on a first time determined from the request; and

selecting the second supplemental content item from the data source based on a second time determined from the state information.

18. The non-transitory computer-readable medium of claim 13, wherein the method further comprises causing the second supplemental content item to be presented in response to determining that the state information was received prior to the end of the program and in response to determining that the state information was received within a predetermined time from the presentation of the content interface.