Matching of modified visual and audio media
First Claim
1. A method for matching media objects, comprising:
- receiving a plurality of reference objects, each reference object comprising a respective first sequence of reference image frames;
computing respective reference feature vectors of one or more of the reference image frames in each of the reference objects;
receiving a query object, comprising a second sequence of query image frames;
computing a respective query feature vector of at least one of the query image frames;
searching the reference feature vectors to find one or more candidate objects among the reference objects, using a coarse matching criterion to match a respective reference feature vector of one of the reference image frames in each of the one or more candidate objects to the query feature vector;
comparing at least one additional reference image frame, which follows the one of the reference image frames in each of the one or more candidate objects, to at least one additional query image frame, which follows the at least one of the query image frames in the query object, using a fine matching criterion, different from the coarse matching criterion, in order to determine that one of the candidate objects is a match for the query object; and
outputting a record of the match,wherein computing the respective reference feature vectors and query feature vector comprises computing multiple feature vectors of at least one frame from among the reference image frames and the query image frames, the multiple feature vectors corresponding to different base characteristics of the query image frames relative to the reference image frames,wherein the base characteristics are selected from a group of image characteristics consisting of an aspect ratio, image borders, scaling, and shift, andwherein searching the reference feature vectors comprises identifying, responsively to the base characteristics, a conversion to be applied to one or more of the query and candidate objects in order to satisfy the coarse matching criterion.
10 Assignments
0 Petitions
Accused Products
Abstract
A method for matching media objects includes receiving a plurality of reference objects, and computing respective reference feature vectors (104, 106) of one or more of the reference image frames (86, 88) in each of the reference objects. Upon receiving a query object, a respective query feature vector (110) of at least one of the query image frames is computed. The reference feature vectors are searched to find one or more candidate objects among the reference objects, such that a respective reference feature vector of one of the reference image frames in each of the one or more candidate objects matches the query feature vector. At least one additional reference image frame is compared to at least one additional query image frame in order to determine that one of the candidate objects is a match for the query object.
-
Citations
18 Claims
-
1. A method for matching media objects, comprising:
-
receiving a plurality of reference objects, each reference object comprising a respective first sequence of reference image frames; computing respective reference feature vectors of one or more of the reference image frames in each of the reference objects; receiving a query object, comprising a second sequence of query image frames; computing a respective query feature vector of at least one of the query image frames; searching the reference feature vectors to find one or more candidate objects among the reference objects, using a coarse matching criterion to match a respective reference feature vector of one of the reference image frames in each of the one or more candidate objects to the query feature vector; comparing at least one additional reference image frame, which follows the one of the reference image frames in each of the one or more candidate objects, to at least one additional query image frame, which follows the at least one of the query image frames in the query object, using a fine matching criterion, different from the coarse matching criterion, in order to determine that one of the candidate objects is a match for the query object; and outputting a record of the match, wherein computing the respective reference feature vectors and query feature vector comprises computing multiple feature vectors of at least one frame from among the reference image frames and the query image frames, the multiple feature vectors corresponding to different base characteristics of the query image frames relative to the reference image frames, wherein the base characteristics are selected from a group of image characteristics consisting of an aspect ratio, image borders, scaling, and shift, and wherein searching the reference feature vectors comprises identifying, responsively to the base characteristics, a conversion to be applied to one or more of the query and candidate objects in order to satisfy the coarse matching criterion. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. Apparatus for matching media objects, comprising:
-
a memory, which is arranged to store a plurality of reference objects, each reference object comprising a respective first sequence of reference image frames; and a content tracker, which is configured to compute respective reference feature vectors of one or more of the reference image frames in each of the reference objects, and upon receiving a query object comprising a second sequence of query image frames, to compute a respective query feature vector of at least one of the query image frames, and to search the reference feature vectors to find one or more candidate objects among the reference objects, using a coarse matching criterion to match a respective reference feature vector of one of the reference image frames in each of the one or more candidate objects to the query feature vector, and to compare at least one additional reference image frame, which follows the one of the reference image frames in each of the one or more candidate objects, to at least one additional query image frame, which follows the at least one of the query image frames in the query object, using a fine matching criterion, different from the coarse matching criterion, in order to determine that one of the candidate objects is a match for the query object, and to output a record of the match, wherein the content tracker is configured to compute multiple feature vectors of at least one frame from among the reference image frames and the query image frames, the multiple feature vectors corresponding to different base characteristics of the query image frames relative to the reference image frames, wherein the base characteristics are selected from a group of image characteristics consisting of an aspect ratio, image borders, scaling, and shift, and wherein the content tracker is configured to identify, responsively to the base characteristics, a conversion to be applied to one or more of the query and candidate objects in order to satisfy the coarse matching criterion.
-
-
17. A computer software product, comprising a tangible, non-transitory computer-readable medium in which program instructions are stored, which instructions, when read by a computer, cause the computer to store a plurality of reference objects, each reference object comprising a respective first sequence of reference image frames, to compute respective reference feature vectors of one or more of the reference image frames in each of the reference objects, and upon receiving a query object comprising a second sequence of query image frames, to compute a respective query feature vector of at least one of the query image frames, and to search the reference feature vectors to find one or more candidate objects among the reference objects, using a coarse matching criterion to match a respective reference feature vector of one of the reference image frames in each of the one or more candidate objects to the query feature vector, and to compare at least one additional reference image frame, which follows the one of the reference image frames in each of the one or more candidate objects, to at least one additional query image frame, which follows the at least one of the query image frames in the query object, using a fine matching criterion, different from the coarse matching criterion, in order to determine that one of the candidate objects is a match for the query object, and to output a record of the match,
wherein the instructions cause the computer to compute multiple feature vectors of at least one frame from among the reference image frames and the query image frames, the multiple feature vectors corresponding to different base characteristics of the query image frames relative to the reference image frames, wherein the base characteristics are selected from a group of image characteristics consisting of an aspect ratio, image borders, scaling, and shift, and wherein the instructions cause the computer to identify, responsively to the base characteristics, a conversion to be applied to one or more of the query and candidate objects in order to satisfy the coarse matching criterion.
-
18. A method for matching media objects, comprising:
-
receiving a plurality of reference objects, each reference object comprising a respective first sequence of reference image frames; computing respective reference feature vectors of one or more of the reference image frames in each of the reference objects; receiving a query object, comprising a second sequence of query image frames; computing a respective query feature vector of at least one of the query image frames; searching the reference feature vectors to find one or more candidate objects among the reference objects, using a coarse matching criterion to match a respective reference feature vector of one of the reference image frames in each of the one or more candidate objects to the query feature vector; comparing at least one additional reference image frame, which follows the one of the reference image frames in each of the one or more candidate objects, to at least one additional query image frame, which follows the at least one of the query image frames in the query object, using a fine matching criterion, different from the coarse matching criterion, in order to determine that one of the candidate objects is a match for the query object; and outputting a record of the match, wherein using the fine matching criterion comprises; performing a comparison between the at least one additional query image frame in the second sequence and a corresponding additional reference image frame in the first sequence; and if the comparison between the at least one additional query image frame and the corresponding additional reference image frame does not yield a match, retrying the comparison between the at least one additional query image frame and one subsequent additional reference image frame, following the corresponding additional reference image frame in the first sequence.
-
Specification