Systems and methods for performing a search based on a media content snapshot image

• US 9,015,139 B2
• Filed: 05/14/2010
• Issued: 04/21/2015
• Est. Priority Date: 05/14/2010
• Status: Active Grant

• Current Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Original Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Inventors: Wong, Ka Chun
• Primary Examiner(s): Woo, Isaac M
• Application Number:
  US12/780,489
• Publication Number:
  US 20110282906A1
• Time in Patent Office: 1,803 Days
• Field of Search: 707600-899
• US Class Current: 707/706
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/587 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06F 16/784 the detected or recognised objects being people
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: G06F 16/787 using geographical or spatial information, e.g. location

Abstract

Systems and methods are provided for performing a search based on a snapshot image captured from media content presented to a user. The snapshot image contains features of the media content that the user wishes to target for the search. A search system recognizes features of the snapshot image and creates a search query based on the snapshot image. The search query is used to identify features of the snapshot image, and search results related to the identified features are presented to the user. Supplemental data or user input received with the snapshot image may be used in analyzing and identifying features of the snapshot image.

Claims

1. A method for performing an image-based search, the method comprising:

receiving a snapshot image captured from video of media content being displayed by user equipment;

receiving supplemental data associated with the media content;

retrieving a plurality of images from a collection of searchable data by comparing the supplemental data to data associated with each image of the plurality of images;

processing visual attributes of each image of the plurality of retrieved images to determine whether at least one image of the plurality of retrieved images includes at least one recognizable feature of the snapshot image;

providing at least one first search result based on determining at least one image of the plurality of retrieved images has the at least one recognizable feature;

receiving a user request to refine the image-based search;

processing at least one new image based at least in part on the user request; and

providing at least one second search result based on the at least one new image.

2. The method of claim 1, wherein the snapshot image contains more than one recognizable feature, and further comprising targeting at least one recognizable feature of the snapshot image based on user input.

3. The method of claim 2, wherein the user input is received in response to a prompt presented to the user to select the recognizable features to be targeted.

4. The method of claim 1, wherein:

the snapshot image contains more than one recognizable feature; and

the providing comprises providing a profile of information for each image of the plurality of retrieved images having the at least one recognizable feature.

5. The method of claim 4, further comprising:

receiving a user selection of an image of the plurality of retrieved images having the at least one recognizable feature; and

providing search results related to the selected image.

6. The method of claim 1, wherein the processing comprises comparing visual patterns of the snapshot image to visual patterns of each image of the plurality of images.

7. The method of claim 1, wherein:

the media content is a broadcast television program; and

the supplemental data is guidance data used in an electronic program guide.

8. The method of claim 1, further comprising:

determining a user'"'"'s location; and

providing search results related to the user'"'"'s location.

9. A search system for performing an image-based search, the system comprising:

processing circuitry configured to;

receive a snapshot image captured from video of media content being displayed by user equipment; and

receive supplemental data associated with the media content; and

searching circuitry responsive to the processing circuitry and configured to;

retrieve a plurality of images from a collection of searchable data by comparing the supplemental data to data associated with each image of the plurality of images;

process visual attributes of each image of the plurality of retrieved images to determine whether at least one image of the plurality of images includes at least one recognizable feature of the snapshot image;

provide at least one first search result based on determining at least one image of the plurality of retrieved images has the at least one recognizable feature;

receive a user request to refine the image-based search;

process at least one new image based at least in part on the user request; and

provide at least one second search result based on the at least one new image.

10. The system of claim 9, wherein the snapshot image contains more than one recognizable feature, and the processing circuitry is further configured to target at least one recognizable feature of the snapshot image based on user input.

11. The system of claim 10, wherein the user input is received by the processing circuitry in response to a prompt presented to the user to select the recognizable features to be targeted.

12. The system of claim 9, wherein:

the snapshot image contains more than one recognizable feature; and

the searching circuitry is configured to provide a profile of information for each image of the plurality of retrieved images having the at least one recognizable feature.

13. The system of claim 12, wherein:

the processing circuitry is further configured to receive a user selection of an image of the plurality of retrieved images having the at least one recognizable feature; and

the searching circuitry is further configured to provide search results related to the selected image.

14. The system of claim 9, wherein the searching circuitry is configured to compare visual patterns of the snapshot image to visual patterns of each image of the plurality of images.

15. The system of claim 9, wherein:

the media content is a broadcast television program; and

the supplemental data is guidance data used in an electronic program guide.

16. The system of claim 9 wherein:

the processing circuitry is further configured to determine a user'"'"'s location; and

the searching circuitry is further configured to provide search results related to the user'"'"'s location.