Methods for using extracted features to perform an action
First Claim
1. A method comprising:
- (a) receiving, at a computer system from a user electronic device, a query related to one or more frames from a video signal displayed at the user electronic device;
(b) receiving, at the computer system, one or more extracted features of the one or more frames, wherein the one or more extracted features include a compact representation of at least a portion of the one or more frames related to one or more blocks of pixels of the frame;
(c) identifying, using the computer system, one or more annotations associated with the one or more frames;
(d) identifying, at the computer system, one or more images related to the one or more frames by comparing the one or more extracted features from the one or more frames with reference features from a first plurality of reference works using a sub-linear search of reference features that identifies one or more matches to the one or more frames but does not guarantee to identify an exact match to the one or more frames, wherein the first plurality of reference works are organized using a tree structure based on annotations including the one or more annotations to eliminate a second plurality of reference works from being searched;
(e) providing, by the computer system to the user electronic device, the identified one or more images along with action information associated with the identified one or more images, wherein the action information is related to an action to be performed at the user electronic device;
(f) receiving, at the computer system from the user electronic device, a selection of one of the identified one or more images; and
(g) providing, to the electronic device, machine readable instructions for performance of the action associated with the selected one of the identified one or more images.
4 Assignments
0 Petitions
Accused Products
Abstract
A computer system comprising one or more processors and computer-readable media operatively connected thereto, having stored thereon instructions for carrying out the steps of: maintaining one or more databases comprising first electronic data comprising digitally created reference compact electronic representations for each of a plurality of reference electronic works and second electronic data associated with the reference electronic works and related to action information corresponding thereto; obtaining a first digitally created compact electronic representation comprising one or more extracted feature vectors of a first electronic work; identifying a matching reference electronic work by comparing the first digitally created compact electronic representation of the first electronic work with the first electronic data using a sub-linear search of the first electronic data; determining the action information corresponding to the matching reference electronic work based on the second electronic data; and associating the determined action information with the first electronic work.
-
Citations
16 Claims
-
1. A method comprising:
-
(a) receiving, at a computer system from a user electronic device, a query related to one or more frames from a video signal displayed at the user electronic device; (b) receiving, at the computer system, one or more extracted features of the one or more frames, wherein the one or more extracted features include a compact representation of at least a portion of the one or more frames related to one or more blocks of pixels of the frame; (c) identifying, using the computer system, one or more annotations associated with the one or more frames; (d) identifying, at the computer system, one or more images related to the one or more frames by comparing the one or more extracted features from the one or more frames with reference features from a first plurality of reference works using a sub-linear search of reference features that identifies one or more matches to the one or more frames but does not guarantee to identify an exact match to the one or more frames, wherein the first plurality of reference works are organized using a tree structure based on annotations including the one or more annotations to eliminate a second plurality of reference works from being searched; (e) providing, by the computer system to the user electronic device, the identified one or more images along with action information associated with the identified one or more images, wherein the action information is related to an action to be performed at the user electronic device; (f) receiving, at the computer system from the user electronic device, a selection of one of the identified one or more images; and (g) providing, to the electronic device, machine readable instructions for performance of the action associated with the selected one of the identified one or more images. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
Specification