Semi-automatic annotation of multimedia objects
First Claim
1. A computer-implemented method comprising:
- storing on a computer readable memory processor-executable instructions;
processing on a processor the processor-executable instructions, wherein the processor-executable instructions perform a method comprising;
maintaining association links between keywords and multimedia objects, the association links being weighted to indicate how relevant the keywords are to the multimedia objects;
retrieving a set of one or more multimedia objects for presentation to a user;
monitoring feedback from the user as to which of the multimedia objects are relevant; and
adjusting the weights of the association of the links between the keywords and multimedia objects, based on the user'"'"'s feedback, wherein the associations are made available for image retrieval and the adjusting comprises increasing and decreasing the weights of the associations between the keywords and the multimedia objects that are deemed relevant by the user, wherein relevance is determined via user feedback.
1 Assignment
0 Petitions
Accused Products
Abstract
A multimedia object retrieval and annotation system integrates an annotation process with object retrieval and relevance feedback processes. The annotation process annotates multimedia objects, such as digital images, with semantically relevant keywords. The annotation process is performed in background, hidden from the user, as the user conducts normal searches. The annotation process is “semi-automatic” in that it utilizes both keyword-based information retrieval and content-based image retrieval techniques to automatically search for multimedia objects, and then encourages users to provide feedback on the retrieved objects. The user identifies objects as either relevant or irrelevant to the query keywords and based on this feedback, the system automatically annotates the objects with semantically relevant keywords and/or updates associations between the keywords and objects. As the retrieval-feedback-annotation cycle is repeated, the annotation coverage and accuracy of future searches continues to improve.
-
Citations
5 Claims
-
1. A computer-implemented method comprising:
-
storing on a computer readable memory processor-executable instructions; processing on a processor the processor-executable instructions, wherein the processor-executable instructions perform a method comprising; maintaining association links between keywords and multimedia objects, the association links being weighted to indicate how relevant the keywords are to the multimedia objects; retrieving a set of one or more multimedia objects for presentation to a user; monitoring feedback from the user as to which of the multimedia objects are relevant; and adjusting the weights of the association of the links between the keywords and multimedia objects, based on the user'"'"'s feedback, wherein the associations are made available for image retrieval and the adjusting comprises increasing and decreasing the weights of the associations between the keywords and the multimedia objects that are deemed relevant by the user, wherein relevance is determined via user feedback. - View Dependent Claims (2, 3, 4, 5)
-
Specification