Automatically Ranking Multimedia Objects Identified in Response to Search Queries

• US 20100299303A1
• Filed: 05/21/2009
• Published: 11/25/2010
• Est. Priority Date: 05/21/2009
• Status: Abandoned Application

• Current Assignee: Oath Inc. (Verizon Communications Inc.)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Horster, Eva, Slaney, Malcolm Graham, Weinberger, Kilian Quirin
• Application Number:
  US12/470,437
• Publication Number:
  US 20100299303A1
• Time in Patent Office: Days
• US Class Current: 706/52
• CPC Class Codes: G06F 16/3346 using probabilistic model
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles

Abstract

Construct a statistical model for a plurality of multimedia objects identified in response to a search query, the statistical model comprising a plurality of probabilities, wherein each of the multimedia objects uniquely corresponding to a different one of a plurality of sets of feature values, each of the feature values of each of the sets of feature values being a characterization of the multimedia object corresponding to the set of feature values, and each of the probabilities being calculated for a different one of the multimedia objects based on the set of feature values corresponding to the multimedia object. Rank the multimedia objects based on their corresponding probabilities, such that a multimedia object having a relatively higher probability is ranked relatively higher.

Claims

1. A method, comprising:

constructing by one or more computer systems a statistical model for a plurality of multimedia objects identified in response to a search query, the statistical model comprising a plurality of probabilities, wherein;

each of the multimedia objects uniquely corresponding to a different one of a plurality of sets of feature values,

each of the feature values of each of the sets of feature values being a characterization of the multimedia object corresponding to the set of feature values, and

each of the probabilities being calculated for a different one of the multimedia objects based on the set of feature values corresponding to the multimedia object; and

ranking the multimedia objects based on their corresponding probabilities, such that a multimedia object having a relatively higher probability is ranked relatively higher.

2. The method as recited in claim 1, wherein for each of the multimedia objects and its corresponding set of feature values, each feature value of the set of feature values uniquely corresponds to a different one of a set of features and has a value that characterizes the corresponding multimedia object with respect to its corresponding feature.

3. The method as recited in claim 2, wherein the set of features comprises one or more audio features, one or more visual features, one or more textual features, one or more geographic features, or one or more temporal features.

4. The method as recited in claim 1, wherein each of the probabilities is calculated for its corresponding multimedia object based on the set of feature values corresponding to the multimedia object as:

P(O)=P(f₁, . . . , f_n)

where O denotes the corresponding multimedia object, f₁ . . . f_n denotes the set of feature values corresponding to O, P(O) denotes the probability calculated for O, and P(f₁, . . . , f_n) denotes a probability of f₁ . . . f_n.

5. The method as recited in claim 4, wherein each of the probabilities is approximated as:

6. The method as recited in claim 5, wherein for each of the multimedia objects and its corresponding set of feature values, the set of feature values comprises a first feature value and a second feature value, a first statistical sub-model is used to calculate the probability of the first feature value, and a second statistical sub-model is used to calculate the probability of the second feature value.

7. The method as recited in claim 6, further comprising pre-training the first statistical sub-model.

8. The method as recited in claim 6, wherein for each of the multimedia objects and its corresponding set of feature values, the first feature value is a visual feature value, and the first statistical sub-model is locally shift-invariant, sparse representations.

9. The method as recited in claim 6, wherein for each of the multimedia objects and its corresponding set of feature values, the second feature value is a textual feature value, and the second statistical sub-model is a combination of word and content description.

10. The method as recited in claim 1, further comprising:

generating a search result for the search query, the search result comprising one or more of the multimedia objects ordered based on their corresponding ranks, wherein between a first one of the multimedia objects having a first rank and a second one of the multimedia objects having a second rank, the first multimedia object is placed before the second multimedia object in the search result if the first rank is greater than the second rank; and

presenting the search result to a user requesting the search query based on their ranks.

11. The method as recited in claim 10, further comprising displaying the search result for the user.

12. An apparatus comprising:

a memory comprising instructions executable by one or more processors; and

one or more processors coupled to the memory and operable to execute the instructions, the one or more processors being operable when executing the instructions to;

construct a statistical model for a plurality of multimedia objects identified in a search result generated in response to a search query by a search engine, the statistical model comprising a plurality of probabilities, wherein;

each of the multimedia objects uniquely corresponding to a different one of a plurality of sets of feature values,

each of the feature values of each of the sets of feature values being a characterization of the multimedia object corresponding to the set of feature values, and

each of the probabilities being calculated for a different one of the multimedia objects based on the set of feature values corresponding to the multimedia object; and

rank the multimedia objects based on their corresponding probabilities, such

that a multimedia object having a relatively higher probability is ranked relatively higher.

13. The apparatus as recited in claim 12, wherein for each of the multimedia objects and its corresponding set of feature values, each feature value of the set of feature values uniquely corresponds to a different one of a set of features and has a value that characterizes the corresponding multimedia object with respect to its corresponding feature.

14. The apparatus as recited in claim 13, wherein the set of features comprises one or more audio features, one or more visual features, one or more textual features, one or more geographic features, or one or more temporal features.

15. The apparatus as recited in claim 12, wherein each of the probabilities is calculated for its corresponding multimedia object based on the set of feature values corresponding to the multimedia object as:

P(O)=P(f₁, . . . , f_n)

where O denotes the corresponding multimedia object, f₁ . . . f_n denotes the set of feature values corresponding to O, P(O) denotes the probability calculated for O, and P(f₁, . . . , f_n) denotes a probability of f₁ . . . f_n.

16. The apparatus as recited in claim 15, wherein each of the probabilities is approximated as:

17. The apparatus as recited in claim 16, wherein for each of the multimedia objects and its corresponding set of feature values, the set of feature values comprises a first feature value and a second feature value, a first statistical sub-model is used to calculate the probability of the first feature value, and a second statistical sub-model is used to calculate the probability of the second feature value.

18. The apparatus as recited in claim 17, wherein for each of the multimedia objects and its corresponding set of feature values:

the first feature value is a visual feature value,

the first statistical sub-model is locally shift-invariant, sparse representations.

the second feature value is a textual feature value, and

the second statistical sub-model is a combination of word and content description.

19. The apparatus as recited in claim 12, wherein the one or more processors are further operable when executing the instructions to:

generate a search result for the search query, the search result comprising one or more of the multimedia objects ordered based on their corresponding ranks, wherein between a first one of the multimedia objects having a first rank and a second one of the multimedia objects having a second rank, the first multimedia object is placed before the second multimedia object in the search result if the first rank is greater than the second rank; and

present the search result to a user requesting the search query based on their ranks.

20. One or more computer-readable storage media embodying software operable when executed by one or more computer systems to:

construct a statistical model for a plurality of multimedia objects identified in response to a search query, the statistical model comprising a plurality of probabilities, wherein;

each of the multimedia objects uniquely corresponding to a different one of a plurality of sets of feature values,

each of the feature values of each of the sets of feature values being a characterization of the multimedia object corresponding to the set of feature values, and

each of the probabilities being calculated for a different one of the multimedia objects based on the set of feature values corresponding to the multimedia object; and

rank the multimedia objects based on their corresponding probabilities, such that a multimedia object having a relatively higher probability is ranked relatively higher.

21. The media as recited in claim 20, wherein for each of the multimedia objects and its corresponding set of feature values, each feature value of the set of feature values uniquely corresponds to a different one of a set of features and has a value that characterizes the corresponding multimedia object with respect to its corresponding feature.

22. The media as recited in claim 21, wherein the set of features comprises one or more audio features, one or more visual features, one or more textual features, one or more geographic features, or one or more temporal features.

23. The media as recited in claim 20, wherein each of the probabilities is calculated for its corresponding multimedia object based on the set of feature values corresponding to the multimedia object as:

P(O)=P(f₁, . . . , f_n)

where O denotes the corresponding multimedia object, f₁ . . . f_n denotes the set of feature values corresponding to O, P(O) denotes the probability calculated for O, and P(f₁, . . . , f_n) denotes a probability of f₁ . . . f_n.

24. The media as recited in claim 23, wherein each of the probabilities is approximated as:

25. The media as recited in claim 24, wherein for each of the multimedia objects and its corresponding set of feature values, the set of feature values comprises a first feature value and a second feature value, a first statistical sub-model is used to calculate the probability of the first feature value, and a second statistical sub-model is used to calculate the probability of the second feature value.

26. The media as recited in claim 25, wherein for each of the multimedia objects and its corresponding set of feature values:

the first feature value is a visual feature value,

the first statistical sub-model is locally shift-invariant, sparse representations.

the second feature value is a textual feature value, and

the second statistical sub-model is a combination of word and content description.

27. The media as recited in claim 20, wherein the software is further operable when executed by one or more computer systems to:

generate a search result for the search query, the search result comprising one or more of the multimedia objects ordered based on their corresponding ranks, wherein between a first one of the multimedia objects having a first rank and a second one of the multimedia objects having a second rank, the first multimedia object is placed before the second multimedia object in the search result if the first rank is greater than the second rank; and

present the search result to a user requesting the search query based on their ranks.