Methods for using extracted features and annotations associated with an electronic media work to perform an action
First Claim
1. A method comprising:
- receiving, at a computer system from a user electronic device, a query related to at least a portion of an electronic media work comprising an image displayed at the user electronic device;
identifying, using the computer system, one or more annotations associated with the at least the portion of the electronic media work;
extracting, using the computer system, one or more features of the at least the portion of the electronic media work, wherein the extracted features are a compact representation of the at least the portion of the electronic media work related to one or more blocks of pixels of the image;
identifying, at the computer system, one or more reference works based on a comparison of one or more annotations associated with the one or more reference works with the one or more annotations associated with the at least the portion of the electronic media work;
identifying, at the computer system, one or more images related to the at least the portion of the electronic media work based at least in part on an approximate nearest neighbor search, which is a sub-linear search of an electronic database of reference features corresponding to the one or more reference works that identifies any match within a threshold of at least one of the reference features to the extracted one or more features but does not guarantee to identify the closest match to the extracted one or more features;
providing, by the computer system to the user electronic device, the identified one or more images along with action information associated with the identified one or more images, wherein the action information is related to an action to be performed at the user electronic device;
receiving, at the computer system from the user electronic device, a selection of one of the identified one or more images; and
providing, to the electronic device, machine readable instructions for performance of the action associated with the selected one of the identified one or more images.
4 Assignments
0 Petitions
Accused Products
Abstract
A method including the steps of: receiving, by a computer system including at least one computer, a first electronic media work uploaded from a first electronic device; extracting one or more features from the first electronic media work; linking the first electronic media work with a reference electronic media work identifier associated with a reference electronic media work to generate correlation information using an approximate nearest neighbor search; storing the correlation information; receiving, from a second electronic device, a query related to the first electronic media work; correlating the query with action information related to an action to be performed and associated with the reference electronic media work identifier based at least in part on the correlation information; generating machine-readable instructions based upon the action information; and providing to the second electronic device, the machine-readable instructions to be used in performing the action.
559 Citations
12 Claims
-
1. A method comprising:
-
receiving, at a computer system from a user electronic device, a query related to at least a portion of an electronic media work comprising an image displayed at the user electronic device; identifying, using the computer system, one or more annotations associated with the at least the portion of the electronic media work; extracting, using the computer system, one or more features of the at least the portion of the electronic media work, wherein the extracted features are a compact representation of the at least the portion of the electronic media work related to one or more blocks of pixels of the image; identifying, at the computer system, one or more reference works based on a comparison of one or more annotations associated with the one or more reference works with the one or more annotations associated with the at least the portion of the electronic media work; identifying, at the computer system, one or more images related to the at least the portion of the electronic media work based at least in part on an approximate nearest neighbor search, which is a sub-linear search of an electronic database of reference features corresponding to the one or more reference works that identifies any match within a threshold of at least one of the reference features to the extracted one or more features but does not guarantee to identify the closest match to the extracted one or more features; providing, by the computer system to the user electronic device, the identified one or more images along with action information associated with the identified one or more images, wherein the action information is related to an action to be performed at the user electronic device; receiving, at the computer system from the user electronic device, a selection of one of the identified one or more images; and providing, to the electronic device, machine readable instructions for performance of the action associated with the selected one of the identified one or more images. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
Specification