Methods, systems, and media for presenting mobile content corresponding to media content

• US 9,247,309 B2
• Filed: 03/14/2013
• Issued: 01/26/2016
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Oztaskent, Ant, Volovich, Yaroslav, Singleton, David, Drayson, Timbo
• Primary Examiner(s): FLYNN, RANDY A
• Application Number:
  US13/827,413
• Publication Number:
  US 20140282660A1
• Time in Patent Office: 1,048 Days
• Field of Search: 725 9- 21
• US Class Current: 1/1
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4725 using interactive regions of the image, e.g. hot spots details of information retrieval from the Internet by using URLs G06F16/955; processing chained hypermedia data for information retrieval G06F16/94
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program

Abstract

Methods, systems, and media for presenting mobile content corresponding to media content are provided. In some implementations, a method for providing information relating to media content is provided, the method comprising: determining a channel that is providing the television program; causing images relating to the television program to be presented, wherein the images are selected based on the channel and a time parameter; receiving a user selection of an image; identifying an entity within the selected image using one or more image recognition techniques; generating a search query based at least in part on the identified entity; obtaining search results responsive to the generated search query; and causing at least one of the search results to be presented to the mobile device in response to receiving the user selection of the image.

Claims

1. A method for providing information relating to media content, the method comprising:

determining, using a hardware processor, a channel that is providing a television program;

causing, using the hardware processor, a plurality of images relating to the television program to be presented by a mobile device, wherein the plurality of images are selected based on the channel and a time parameter;

receiving, using the hardware processor, a user selection of an image from the plurality of images;

receiving, using the hardware processor, program information relating to the television program, wherein the program information includes information about one or more people appearing in the television program;

causing, using the hardware processor, a plurality of question terms to be presented by the mobile device;

receiving, using the hardware processor, a user selection of a question term from the plurality of question terms, wherein the user selection of the question term indicates that an entity to be identified is a person;

receiving a user selection of a region of interest within the selected image;

in response to receiving the user selection of the question term and the user selection of the region of interest, identifying, using the hardware processor, a person entity within the selected region of interest using one or more facial recognition techniques based on the one or more people appearing in the television program;

generating, using the hardware processor, a search query based at least in part on the identified person entity;

obtaining, using the hardware processor, a plurality of search results responsive to the generated search query; and

causing, using the hardware processor, at least one of the plurality of search results to be presented to the mobile device in response to receiving the user selection of the image.

2. The method of claim 1, further comprising receiving audio data corresponding to a television program from the mobile device, wherein the channel is determined based on the received audio data.

3. The method of claim 2, wherein receiving the audio data further comprises obtaining an audio fingerprint of the audio data.

4. The method of claim 3, further comprising:

extracting an audio stream from each of a plurality of television channels;

generating, for each of the plurality of television channels, at least one audio fingerprint from at least a portion of the extracted audio stream that corresponds to one of the plurality of television channels; and

storing the at least one audio fingerprint in a database indexed by channel.

5. The method of claim 4, further comprising:

comparing the audio fingerprint with the at least one stored audio fingerprint; and

identifying the television program based on the comparison.

6. The method of claim 1, further comprising:

extracting a plurality of programming images from each of a plurality of television channels; and

storing the plurality of programming image in a database indexed by channel and time.

7. The method of claim 6, wherein the plurality of images relating to the television program are presented by using the determined channel and the time parameter to obtain the plurality of images, wherein the plurality of images are a subset of the plurality of extracted programming images.

8. The method of claim 1, further comprising:

detecting a plurality of faces within the selected image using a facial recognition technique;

prompting the mobile device to select a face from the plurality of detected faces; and

identifying the entity associated with the selected face.

9. The method of claim 1, further comprising:

accessing guidance data to determine the television program based on the determined channel and the timing parameter.

10. A system for providing information relating to media content, the system comprising:

a hardware processor that is configured to;

determine a channel that is providing a television program;

cause a plurality of images relating to the television program to be presented by a mobile device, wherein the plurality of images are selected based on the channel and a time parameter;

receive a user selection of an image from the plurality of images;

receive program information relating to the television program, wherein the program information includes information about one or more people appearing in the television program;

cause a plurality of question terms to be presented by the mobile device;

receive a user selection of a question term from the plurality of question terms, wherein the user selection of the question term indicates that an entity to be identified is a person;

receive a user selection of a region of interest within the selected image;

in response to receiving the user selection of the question term and the user selection of the region of interest, identify a person entity within the selected region of interest using one or more image recognition techniques based on the one or more people appearing in the television program;

generate a search query based at least in part on the identified person entity;

obtain a plurality of search results responsive to the generated search query; and

cause at least one of the plurality of search results to be presented to a mobile device in response to receiving the user selection of the image.

11. The system of claim 10, wherein the hardware processor is further configured to receive audio data corresponding to a television program from the mobile device, wherein the channel is determined based on the received audio data.

12. The system of claim 11, wherein the hardware processor is further configured to obtain an audio fingerprint of the audio data.

13. The system of claim 12, wherein the hardware processor is further configured to:

extract an audio stream from each of a plurality of television channels;

generate, for each of the plurality of television channels, at least one audio fingerprint from at least a portion of the extracted audio stream that corresponds to one of the plurality of television channels; and

store the at least one audio fingerprint in a database indexed by channel.

14. The system of claim 13, wherein the hardware processor is further configured to:

compare the audio fingerprint with the at least one stored audio fingerprint; and

identify the television program based on the comparison.

15. The system of claim 10, wherein the hardware processor is further configured to:

extract a plurality of programming images from each of a plurality of television channels; and

store the plurality of programming image in a database indexed by channel and time.

16. The system of claim 15, wherein the hardware processor is further configured to use the determined channel and the time parameter to obtain the plurality of images, wherein the plurality of images are a subset of the plurality of extracted programming images.

17. The system of claim 10, wherein the hardware processor is further configured to:

detect a plurality of faces within the selected image using a facial recognition technique;

prompt the mobile device to select a face from the plurality of detected faces; and

identify the entity associated with the selected face.

18. The system of claim 10, wherein the hardware processor is further configured to:

access guidance data to determine the television program based on the determined channel and the timing parameter.

19. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for providing information relating to media content, the method comprising:

determining a channel that is providing a television program;

causing a plurality of images relating to the television program to be presented by a mobile device, wherein the plurality of images are selected based on the channel and a time parameter;

receiving a user selection of an image from the plurality of images;

receiving program information relating to the television program, wherein the program information includes information about one or more people appearing in the television program;

causing a plurality of question terms to be presented by the mobile device;

receiving a user selection of a question term from the plurality of question terms, wherein the user selection of the question term indicates that an entity to be identified is a person;

receiving a user selection of a region of interest within the selected image;

in response to receiving the user selection of the question term and the user selection of the region of interest, identifying a person entity within the selected region of interest using one or more facial recognition techniques based on the one or more people appearing in the television program;

generating a search query based at least in part on the identified person entity;

obtaining a plurality of search results responsive to the generated search query; and

causing at least one of the plurality of search results to be presented to a mobile device in response to receiving the user selection of the image.

20. The non-transitory computer-readable medium of claim 19, wherein the method further comprises receiving audio data corresponding to a television program from the mobile device, wherein the channel is determined based on the received audio data.

21. The non-transitory computer-readable medium of claim 20, wherein the method further comprises obtaining an audio fingerprint of the audio data.

22. The non-transitory computer-readable medium of claim 21, wherein the method further comprises:

extracting an audio stream from each of a plurality of television channels;

generating, for each of the plurality of television channels, at least one audio fingerprint from at least a portion of the extracted audio stream that corresponds to one of the plurality of television channels; and

storing the at least one audio fingerprint in a database indexed by channel.

23. The non-transitory computer-readable medium of claim 22, wherein the method further comprises:

comparing the audio fingerprint with the at least one stored audio fingerprint; and

identifying the television program based on the comparison.

24. The non-transitory computer-readable medium of claim 19, wherein the method further comprises:

extracting a plurality of programming images from each of a plurality of television channels; and

storing the plurality of programming image in a database indexed by channel and time.

25. The non-transitory computer-readable medium of claim 24, wherein the method further comprises using the determined channel and the time parameter to obtain the plurality of images, wherein the plurality of images are a subset of the plurality of extracted programming images.

26. The non-transitory computer-readable medium of claim 19, wherein the method further comprises:

detecting a plurality of faces within the selected image using a facial recognition technique;

prompting the mobile device to select a face from the plurality of detected faces; and

identifying the entity associated with the selected face.

27. The non-transitory computer-readable medium of claim 19, wherein the method further comprises:

accessing guidance data to determine the television program based on the determined channel and the timing parameter.