Stochastic visually based image query and retrieval system

• US 6,574,616 B1
• Filed: 04/07/2000
• Issued: 06/03/2003
• Est. Priority Date: 02/16/2000
• Status: Expired due to Term

• Current Assignee: Chartoleaux KG LLC (Intellectual Ventures LLC)
• Original Assignee: Index Stock Imagery, Inc. (Getty Images Incorporated)
• Inventors: Saghir, Jamil
• Primary Examiner(s): Corrielus, Jean M.
• Assistant Examiner(s): FLEURANTIN, JEAN B
• Application Number:
  US09/545,314
• Time in Patent Office: 1,152 Days
• Field of Search: 707/3-6, 707/9-10, 707/104.1, 707/1, 358/403, 382/305
• US Class Current: 382/305
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: Y10S 707/915 Image
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

An image search and retrieval system for searching and retrieving a desired image from a collection of images is provided. The system includes a computer and a plurality of images accessible by the computer. Each of the images has associated therewith an image profile also accessible by the computer. A plurality of selection probability functions are provided, which are set to initial values at the beginning of the search. Software executing on the computer selects a plurality of images based upon the relationship between the profile for each image and the values of the selection probability functions, and displays the selected images. Software executing on the computer receives an indication of at least one chosen image and adjusts the value of each of the selection probability functions based upon the profiles of the chosen images. The software selects and displays images, receives an indication of at least one chosen image, and adjusts the value of each of the selection probability functions iteratively until the search is terminated. Preferably, each image profile comprises a plurality of rankings for a plurality of categories, and most preferably, the plurality of rankings comprise a plurality of characteristic functions, each of which represents a probability distribution function which describes the probability of an image being selected given user preferences within a category. The plurality of characteristic functions may take the form of a Gaussian function, or a bell curve, although such is not strictly required.

Claims

1. An image search system comprising:

a computer;

a plurality of images accessible by said computer, each of the plurality of images having associated therewith an image profile accessible by said computer, the image profile comprising information about the subject matter of the associated image;

a plurality of selection probability functions, said plurality of selection probability functions being set to initial values;

software executing on said computer for iteratively selecting and displaying a plurality of images, the plurality of images being selected based upon the relationship between the profile for each image and the values of the selection probability functions; and

software executing on said computer being responsive to a selection of one or more chosen images and iteratively adjusting the value of one or more of the selection probability functions based upon the profiles of the chosen images, wherein said software selects and displays, receives an indication of at least one chosen image, and adjusts the value of each of the selection probability functions iteratively until the search is terminated.

2. The image search system of claim 1 wherein each image profile comprises a plurality of categories, with a ranking of the image for one or more of said plurality of categories.

3. The image search system of claim 2 wherein each ranking comprises a characteristic function.

4. The image search system of claim 3 wherein said characteristic function comprises a probability distribution function which describes the probability of an image being selected given user preferences within a category.

5. The image search system of claim 4 wherein said characteristic function comprises a Gaussian function.

6. The image search system of claim 4 wherein said characteristic function comprises a bell curve.

7. The image search system of claim 2 wherein each of said selection probability functions corresponds to one of the categories.

8. The image search system of claim 7 wherein the initial values of said plurality of selection probability functions are set such that statistical weighting among the categories is even and no category is favored.

9. The image search system of claim 7 wherein said software executing on said computer for selecting and displaying a plurality of images randomly selects values for each category, which value is in accordance with the selection probability function for that category, and selects images having characteristic functions corresponding to the randomly selected values for the categories.

10. The image search system of claim 1 wherein each of the selection probability functions comprises a probability distribution function which describes the probability of a desired image being found given the initial value of the selection probability function and the profiles of previously chosen images.

11. An image search system comprising:

a computer;

a plurality of images accessible by said computer, each of the plurality of images having associated therewith a plurality of characteristic functions for a plurality of categories accessible by said computer, at least one of the plurality of categories relating to the subject matter of the associated image;

a plurality of selection probability functions, each of said selection probability functions corresponding to one of the categories, said plurality of selection probability functions being set to initial values;

software executing on said computer for selecting and displaying a plurality of images, the plurality of images being selected based upon the relationship between the characteristic functions for each image and the values of the selection probability functions;

software executing on said computer for receiving an indication of at least one chosen image and for adjusting the value of each of the selection probability functions based upon the characteristic functions of the chosen images; and

wherein said software selects and displays, receives an indication of at least one chosen image, and adjusts the value of each of the selection probability functions iteratively until the search is terminated.

12. The image search system of claim 11 wherein each of the plurality of characteristic functions comprises a probability distribution function which describes the probability of an image being selected given user preferences within a category.

13. The image search system of claim 12 wherein one or more of the plurality of characteristic functions comprises a Gaussian function.

14. The image search system of claim 12 wherein one or more of the plurality of characteristic functions comprises a bell curve.

15. The image search system of claim 11 wherein each of the selection probability functions comprises a probability distribution function which describes the probability of a desired image being found given the initial value of the selection probability function and the characteristic functions of previously chosen images.

16. The image search system of claim 11 wherein the initial values of said plurality of selection probability functions are set such that statistical weighting among the categories is even and no category is favored.

17. The image search system of claim 11 wherein said software executing on said computer for selecting and displaying a plurality of images randomly selects values for each category, which value is in accordance with the selection probability function for that category, and selects images having characteristic functions corresponding to the randomly selected values for the categories.

18. An image search system comprising:

a computer;

a database accessible by said computer;

a plurality of images stored on said database, each of the plurality of images having associated therewith information about the subject matter of the associated image; and

software executing on said computer for iteratively selecting images randomly from said plurality of images by using a stochastic process which takes into account the subject matter of the associated images, for gathering user suggestions, and for skewing the random selection toward the user suggestions.

19. The image search system of claim 18 wherein said software iteratively selects images randomly from said plurality of images by using a stochastic process based upon at least one probability distribution function.

20. A method for searching and retrieving a desired image comprising the steps of:

providing a computer;

providing a plurality of images accessible by the computer, each of the plurality of images having associated therewith an image profile accessible by the computer, the image profile comprising information about the subject matter of the associated image;

providing a plurality of selection probability functions;

setting the plurality of selection probability functions to initial values;

selecting a plurality of images based upon the relationship between the profile for each image and the values of the selection probability functions;

displaying the selected images;

receiving an indication of at least one chosen image;

adjusting the value of each of the selection probability functions based upon the profiles of the chosen images; and

repeating said selecting step, said displaying step, said receiving step and said adjusting step until the search is terminated.

21. The method of claim 20 wherein each image profile comprises a plurality of rankings for a plurality of categories.

22. The method of claim 21 wherein the plurality of rankings comprise a plurality of characteristic functions.

23. The method of claim 22 wherein each of the plurality of characteristic functions comprises a probability distribution function which describes the probability of an image being selected given user preferences within a category.

24. The method of claim 23 wherein one or more of the plurality of characteristic functions comprises a Gaussian function.

25. The method of claim 23 wherein one or more of the plurality of characteristic functions comprises a bell curve.

26. The method of claim 21 wherein each of said selection probability functions corresponds to one of the categories.

27. The method of claim 26 wherein said setting the plurality of selection probability functions to initial values step comprises the step of setting the initial values of the plurality of selection probability functions such that statistical weighting among the categories is even and no category is favored.

28. The method of claim 26 wherein said step of selecting a plurality of images comprises randomly selecting values for each category, which value is in accordance with the selection probability function for that category, and selecting images having characteristic functions corresponding to the randomly selected values for the categories.

29. The method of claim 20 wherein each of the selection probability functions comprises a probability distribution function which describes the probability of a desired image being found given the initial value of the selection probability function and the profiles of previously chosen images.

30. A method for searching and retrieving a desired image comprising the steps of:

providing a computer;

providing a plurality of images accessible by the computer, each of the plurality of images having associated therewith a plurality of characteristic functions for a plurality of categories accessible by the computer, at least one of the plurality of categories relating to the subject matter of the associated image;

providing a plurality of selection probability functions, each of the selection probability functions corresponding to one of the categories;

setting the plurality of selection probability functions to initial values;

selecting a plurality of images based upon the relationship between the characteristic functions for each image and the values of the selection probability functions;

displaying the selected images;

receiving an indication of at least one chosen image;

adjusting the value of each of the selection probability functions based upon the characteristic functions of the chosen images; and

repeating said selecting step, said displaying step, said receiving step and said adjusting step until the search is terminated.

31. The method of claim 30 wherein each of the plurality of characteristic functions comprises a probability distribution function which describes the probability of an image being selected given user preferences within a category.

32. The method of claim 31 wherein one or more of the plurality of characteristic functions comprises a Gaussian function.

33. The method of claim 31 wherein one or more of the plurality of characteristic functions comprises a bell curve.

34. The method of claim 30 wherein each of the selection probability functions comprises a probability distribution function which describes the probability of a desired image being found given the initial value of the selection probability function and the characteristic functions of previously chosen images.

35. The image search system of claim 30 wherein said setting the plurality of selection probability functions to initial values step comprises the step of setting the initial values of the plurality of selection probability functions such that statistical weighting among the categories is even and no category is favored.

36. The method of claim 30 wherein said selecting a plurality of images step comprises the step of randomly selecting values for each category, which value is in accordance with the selection probability function for that category, and selecting images having characteristic functions corresponding to the randomly selected values for the categories.

37. A method for searching and retrieving a desired image comprising the steps of:

providing a computer;

providing a database accessible by the computer;

storing a plurality of images on the database, each of the plurality of images having associated therewith information about the subject matter of the associated image;

selecting images randomly from the plurality of images by using a stochastic process which takes into account the subject matter of the associated images;

gathering user suggestions;

skewing the random selection toward the user suggestions; and

iteratively repeating said selecting step, said gathering step and said skewing step until the search is terminated.

38. The method of claim 37 wherein said selecting step comprises the step of selecting images randomly from the plurality of images by using a stochastic process based upon at least one probability distribution function.

39. An image search system comprising:

a computer;

a plurality of images accessible by said computer, each of the plurality of images having associated therewith an image profile accessible by said computer;

a plurality of selection probability functions, said plurality of selection probability functions being set to initial values, wherein each of said selection probability functions is a statistical function;

software executing on said computer for iteratively selecting and displaying a plurality of images, the plurality of images being selected based upon the relationship between the profile for each image and the values of the selection probability functions; and

software executing on said computer being responsive to a selection of one or more chosen images and iteratively adjusting the value of one or more of the selection probability functions based upon the profiles of the chosen images, wherein said software selects and displays, receives an indication of at least one chosen image, and adjusts the value of each of the selection probability functions iteratively until the search is terminated.

40. The image search system of claim 39 wherein each image profile comprises a plurality of categories, with a ranking of the image for one or more of said plurality of categories.

41. The image search system of claim 40 wherein each ranking comprises a characteristic function.

42. The image search system of claim 41 wherein said characteristic function comprises a probability distribution function which describes the probability of an image being selected given user preferences within a category.

43. The image search system of claim 42 wherein said characteristic function comprises a Gaussian function.

44. The image search system of claim 42 wherein said characteristic function comprises a bell curve.

45. The image search system of claim 40 wherein each of said selection probability functions corresponds to one of the categories.

46. The image search system of claim 45 wherein the initial values of said plurality of selection probability functions are set such that statistical weighting among the categories is even and no category is favored.

47. The image search system of claim 45 wherein said software executing on said computer for selecting and displaying a plurality of images randomly selects values for each category, which value is in accordance with the selection probability function for that category, and selects images having characteristic functions corresponding to the randomly selected values for the categories.

48. The image search system of claim 39 wherein each of the selection probability functions comprises a probability distribution function which describes the probability of a desired image being found given the initial value of the selection probability function and the profiles of previously chosen images.