Computer user interface for perception-based information retrieval

• US 20030016250A1
• Filed: 05/22/2002
• Published: 01/23/2003
• Est. Priority Date: 04/02/2001
• Status: Abandoned Application

• Current Assignee: VIM Technologies Ltd (MAI Holdings, Inc.)
• Original Assignee: VIM Technologies Ltd (MAI Holdings, Inc.)
• Inventors: Lai, Wei-Cheng, Chang, Edward Y., Cheng, Kwang-Ting
• Application Number:
  US10/155,837
• Publication Number:
  US 20030016250A1
• Time in Patent Office: Days
• US Class Current: 345/810
• CPC Class Codes: G06F 16/532 Query formulation, e.g. graphical querying

Abstract

A computer user interface screen comprising:

a set of multiple possible sample representations of a user query concept in which individual samples of the set of query samples are characterized by a maximum uncertainty as to whether a given user would consider a given individual sample representation to be relevant to that given user'"'"'s query concept based upon that given user'"'"'s prior indications of relevance of prior sample representations to that given user'"'"'s query concept.

Claims

1. A computer user interface screen comprising:

a set of multiple possible sample representations of a user query concept in which individual samples of the set of query samples are characterized by a maximum uncertainty as to whether a given user would consider a given individual sample representation to be relevant to that given user'"'"'s query concept based upon that given user'"'"'s prior indications of relevance of prior sample representations to that given user'"'"'s query concept.

2. The computer user interface screen of claim 1 wherein,

the given user'"'"'s prior indications of relevance of prior sample representations to that given user'"'"'s query concept include both positive and negative indications of relevance.

3. The computer user interface screen of claim 1 wherein,

the given user'"'"'s prior indications of relevance of prior sample representations to that given user'"'"'s query concept include both positive and negative indications of relevance;

and

only the user'"'"'s positive indications of relevance are explicit.

4. The computer user interface screen of claim 1 wherein,

the given user'"'"'s prior indications of relevance of prior sample representations to that given user'"'"'s query concept include both positive and negative indications of relevance;

and

only the user'"'"'s negative indications of relevance are explicit.

5. The computer user interface screen of claim 1 further including:

a mechanism to receive a user indication of relevance of one or more sample representations to the user'"'"'s query concept.

6. The computer user interface screen of claim 1 further including:

a set of one or more results representations characterized by similarity to the given user'"'"'s query concept based upon the given user'"'"'s indications of relevance of prior sample representations to that given user'"'"'s query concept.

7. The computer user interface screen of claim 1 further including:

a set of K results representations characterized by similarity to the given user'"'"'s query concept based upon the given user'"'"'s indications of relevance of prior sample representations to that given user'"'"'s query concept;

wherein K is a user-selectable value; and

wherein the set of K results representations includes the top K most similar representations with respect to the user'"'"'s query concept based upon the user'"'"'s indications of relevance of prior sample representations to that given user'"'"'s query concept.

8. The computer user interface screen of claim 6 or 7 wherein,

the given user'"'"'s prior indications of relevance of prior sample representations to that given user'"'"'s query concept include both positive and negative indications of relevance.

9. The computer user interface screen of claim 6 or 7 wherein,

the given user'"'"'s prior indications of relevance of prior sample representations to that given user'"'"'s query concept include both positive and negative indications of relevance;

and

only the user'"'"'s positive indications of relevance are explicit.

10. The computer user interface screen of claim 6 or 7 wherein,

the given user'"'"'s prior indications of relevance of prior sample representations to that given user'"'"'s query concept include both positive and negative indications of relevance;

and

only the user'"'"'s negative indications of relevance are explicit.

11. The computer user interface screen of claim 1 wherein,

respective individual samples of the set of multiple possible query sample representations are respectively characterized by a plurality of features from a feature space;

and

respective the samples of the set of multiple possible query sample representations are well separated from each other in the feature space.

12. The computer user interface screen of claim 11 wherein,

the feature space includes a range of color features and a range of texture features.

13. The computer user interface screen of claim 11 wherein,

the feature space includes a range of color features and a range of texture features and a range of shape features.

14. The computer user interface screen of claim 1 wherein,

the maximum uncertainty characterizing the individual sample representation is achieved by composing the set of multiple possible query sample representations with sample representations that are at or near a prescribed distance from a query concept space;

wherein the prescribed distance is arrived at arrived at using an algorithm that maximizes the expected generalization of a query concept.

15. The computer user interface screen of claim 1 wherein,

the maximum uncertainty characterizing the individual sample representation is achieved by composing the set of multiple possible query sample representations with sample representations that are near a hyperplane;

wherein the hyperplane is arrived at using a support vector machine algorithm.

16. The computer user interface screen of claim 1 wherein,

the maximum uncertainty characterizing the individual sample representation is achieved by composing the set of multiple possible query sample representations with sample representations that are labeled as possessing at or near maximum uncertainty as to whether the given user would indicate such sample representations as being relevant to the user'"'"'s query concept;

wherein the labeling is arrived at using a Bayesian algorithm.

18. The computer user interface of claim 17 further including:

a mechanism to receive a user indication of relevance of one or more sample objects to the user'"'"'s query concept.

19. The computer user interface of claim 17 further including:

a set of one or more results objects characterized by similarity to the given user'"'"'s query concept based upon the given user'"'"'s indications of relevance of sample objects to that given user'"'"'s query concept.

20. The computer user interface of claim 17 wherein,

the given user'"'"'s prior indications of relevance of prior sample objects to that given user'"'"'s query concept include both positive and negative indications of relevance;

and

only the user'"'"'s negative indications of relevance are explicit.

21. The computer user interface of claim 17 further including:

a mechanism to receive a user indication of relevance of one or more sample objects to the user'"'"'s query concept.

22. The computer user interface of claim 17 further including:

a set of one or more results objects characterized by similarity to the given user'"'"'s query concept based upon the given user'"'"'s indications of relevance of prior sample objects to that given user'"'"'s query concept.

23. The computer user interface of claim 17 further including:

a set of K results objects characterized by similarity to the given user'"'"'s query concept based upon the given user'"'"'s indications of relevance of prior sample objects to that given user'"'"'s query concept;

wherein K is a user-selectable value; and

wherein the set of K results objects includes the top K most similar objects with respect to the user'"'"'s query concept based upon the user'"'"'s indications of relevance of prior sample objects to that given user'"'"'s query concept.

24. The computer user interface of claim 22 or 23 wherein,

the given user'"'"'s prior indications of relevance of prior sample objects to that given user'"'"'s query concept include both positive and negative indications of relevance.

25. The computer user interface of claim 22 or 23 wherein,

the given user'"'"'s prior indications of relevance of prior sample objects to that given user'"'"'s query concept include both positive and negative indications of relevance;

and

only the user'"'"'s positive indications of relevance are explicit.

26. The computer user interface of claim 22 or 23 wherein,

the given user'"'"'s prior indications of relevance of prior sample objects to that given user'"'"'s query concept include both positive and negative indications of relevance;

and

only the user'"'"'s negative indications of relevance are explicit.

27. The computer user interface of claim 17 wherein,

respective individual samples of the set of multiple possible query sample objects are respectively characterized by a plurality of features from a feature space;

and

respective the sample objects of the set of multiple possible query sample objects are well separated from each other in the feature space.

28. The computer user interface of claim 27 wherein,

the feature space includes a range of color features and a range of texture features.

29. The computer user interface of claim 27 wherein,

the feature space includes a range of color features and a range of texture features and a range of shape features.

30. The computer user interface of claim 17 wherein,

the maximum uncertainty characterizing the individual sample objects is achieved by composing the set of multiple sample objects with sample objects that are at or near a prescribed distance from a query concept space;

wherein the prescribed distance is arrived at arrived at using an algorithm that maximizes the expected generalization of a query concept.

31. The computer user interface of claim 17 wherein,

the maximum uncertainty characterizing the individual sample objects is achieved by composing the set of multiple sample objects with sample objects that are near a hyperplane;

wherein the hyperplane is arrived at using a support vector machine algorithm.

32. The computer user interface screen of claim 17 wherein,

the maximum uncertainty characterizing the individual sample objects is achieved by composing the set of multiple sample objects with sample objects that are labeled as possessing at or near maximum uncertainty as to whether the given user would indicate such sample representations as being relevant to the user'"'"'s query concept;

wherein the labeling is arrived at using a Bayesian algorithm.

59. A computer readable storage medium encoded with a computer program that functions to produce the computer user interface screen of claim 1 or 6.

17. A computer user interface comprising:

a set of multiple sample objects in which individual sample objects are characterized by a maximum uncertainty as to whether a given user would consider a given individual sample object to be relevant to that given user'"'"'s query concept based upon that given user'"'"'s indications of relevance of prior sample objects to that given user'"'"'s query concept.

33. A computer user interface screen system comprising:

a first sample screen displaying a first set of multiple possible query sample representations of a user query concept in which individual samples of the first set of query samples are characterized by maximum uncertainty as to whether a given user would consider a given individual sample representation of the first set to be relevant to that given user'"'"'s query; and

a second sample screen presented after the first sample screen and displaying a second set of multiple possible query sample representations of a user query concept in which individual samples of the second set of query samples are characterized by maximum uncertainty as to whether a given user would consider a given individual sample representation of the second set to be relevant to that given user'"'"'s query concept based upon that given user'"'"'s indications of relevance of sample representations from the first set of query sample representations to that given user'"'"'s query concept; and

a mechanism to receive a user indication of relevance of one or more sample representations from each of the sets of multiple possible sets of sample representations to the given user'"'"'s query concept.

34. The computer user interface screen system of claim 33 further including:

a third sample screen presented after the second sample screen and displaying a third set of multiple possible query sample representations of a user query concept in which individual samples of the third set of query samples are characterized by maximum uncertainty as to whether a given user would consider a given individual sample representation of the third set to be relevant to that given user'"'"'s query concept based upon that given user'"'"'s indications of relevance of sample representations from the first and second sets of query sample representations to that given user'"'"'s query concept.

35. The computer user interface screen system of claim 34 further including:

a third sample screen presented after the second sample screen and displaying a third set of multiple possible query sample representations of a user query concept in which individual samples of the third set of query samples are characterized by maximum uncertainty as to whether a given user would consider a given individual sample representation of the third set to be relevant to that given user'"'"'s query concept based upon that given user'"'"'s indications of relevance of sample representations from the first and second sets of query sample representations to that given user'"'"'s query concept; and

a fourth sample screen presented after the third sample screen and displaying a fourth set of multiple possible query sample representations of a user query concept in which individual samples of the fourth set of query samples are characterized by significant uncertainty as to whether a given user would consider a given individual sample representation of the fourth set to be relevant to that given user'"'"'s query concept based upon that given user'"'"'s indications of relevance of sample representations from the first, second and third sets of query sample representations to that given user'"'"'s query concept.

36. The computer user interface screen system of claim 33 wherein,

the maximum uncertainty characterizing individual sample representations of the second set is achieved by composing the set of multiple possible query sample representations with sample representations that are at or near a prescribed distance from a query concept space;

wherein the prescribed distance is arrived at arrived at using an algorithm that maximizes the expected generalization of a query concept based upon the given user'"'"'s indications of relevance to the given user'"'"'s query concept of the sample representations of the first set.

37. The computer user interface screen system of claim 34 wherein,

the maximum uncertainty characterizing individual sample representations of the third set is achieved by composing the set of multiple possible query sample representations with sample representations that are at or near a prescribed distance from a query concept space;

wherein the prescribed distance is arrived at arrived at using an algorithm that maximizes the expected generalization of a query concept based upon the given user'"'"'s indications of relevance to the given user'"'"'s query concept of the sample representations of the first and second sets.

38. The computer user interface screen system of claim 35 wherein,

the maximum uncertainty characterizing individual sample representations of the fourth set is achieved by composing the set of multiple possible query sample representations with sample representations that are at or near a prescribed distance from a query concept space;

wherein the prescribed distance is arrived at arrived at using an algorithm that maximizes the expected generalization of a query concept based upon the given user'"'"'s indications of relevance to the given user'"'"'s query concept of the sample representations of the first, second and third sets.

39. The computer user interface screen system of claim 33 wherein,

the maximum uncertainty characterizing individual sample representations of the second set achieved by composing the set of multiple possible query sample representations with sample representations that are near a hyperplane;

wherein the hyperplane is arrived at using a support vector machine algorithm based upon the given user'"'"'s indications of relevance to the given user'"'"'s query concept of the sample representations of the first set.

40. The computer user interface screen system of claim 34 wherein,

the maximum uncertainty characterizing individual sample representations of the third set achieved by composing the set of multiple possible query sample representations with sample representations that are near a hyperplane;

wherein the hyperplane is arrived at using a support vector machine algorithm based upon the given user'"'"'s indications of relevance to the given user'"'"'s query concept of the sample representations of the first and second sets.

41. The computer user interface screen system of claim 35 wherein,

the maximum uncertainty characterizing individual sample representations of the fourth set achieved by composing the set of multiple possible query sample representations with sample representations that are near a hyperplane;

wherein the hyperplane is arrived at using a support vector machine algorithm based upon the given user'"'"'s indications of relevance to the given user'"'"'s query concept of the sample representations of the first, second and third sets.

42. The computer user interface screen system of claim 33 wherein,

the maximum uncertainty characterizing individual sample representations of the second set is achieved by composing the set of multiple possible query sample representations with sample representations that are labeled as possessing at or near maximum uncertainty as to whether the given user would indicate such sample representations as being relevant to the user'"'"'s query concept;

wherein the labeling is arrived at using a Bayesian algorithm based upon the given user'"'"'s indications of relevance to the given user'"'"'s query concept of the sample representations of the first set.

43. The computer user interface screen system of claim 34 wherein,

the maximum uncertainty characterizing individual sample representations of the third set is achieved by composing the set of multiple possible query sample representations with sample representations that are labeled as possessing at or near maximum uncertainty as to whether the given user would indicate such sample representations as being relevant to the user'"'"'s query concept;

wherein the labeling is arrived at using a Bayesian algorithm based upon the given user'"'"'s indications of relevance to the given user'"'"'s query concept of the sample representations of the first and second sets.

44. The computer user interface screen system of claim 35 wherein,

the maximum uncertainty characterizing individual sample representations of the fourth set is achieved by composing the set of multiple possible query sample representations with sample representations that are labeled as possessing at or near maximum uncertainty as to whether the given user would indicate such sample representations as being relevant to the user'"'"'s query concept;

wherein the labeling is arrived at using a Bayesian algorithm based upon the given user'"'"'s indications of relevance to the given user'"'"'s query concept of the sample representations of the first, second and third sets.

45. The computer user interface screen system of claim 33 further including:

a first results screen presented together with the second sample screen and displaying a first set of one or more results representations characterized by similarity to the given user'"'"'s query concept based upon the given user'"'"'s indications of relevance of prior sample representations to that given user'"'"'s query concept.

46. The computer user interface screen system of claim 45 further including:

a second results screen presented together with the third sample screen and displaying a second set of one or more results representations characterized by similarity to the given user'"'"'s query concept based upon the given user'"'"'s indications of relevance of prior sample representations to that given user'"'"'s query concept.

47. The computer user interface screen system of claim 46 further including:

a third results screen presented together with the fourth sample screen and displaying a third set of one or more results representations characterized by similarity to the given user'"'"'s query concept based upon the given user'"'"'s indications of relevance of prior sample representations to that given user'"'"'s query concept.

48. The computer user interface screen system of claim 33 further including:

a screen mechanism to receive a user indication of relevance of one or more sample representations to the user'"'"'s query concept.

49. The computer user interface screen system of claim 45 wherein

the first results screen is associated with a query by example screen input to receive a user indication of desire receive one or more results representations that are similar to one or more user-indicated results representations displayed by the first results screen.

50. The computer user interface screen system of claim 45 wherein

the first results screen is associated with a query by example screen input to receive a user indication of desire receive one or more results representations that are similar to one or more user-indicated results representations displayed by the first results screen;

and

the query by example screen input includes feature input to receive a user indication as to one or more features of the one or more additional sample representations are to match corresponding features of the at least one current sample representation.

51. The computer user interface screen system of claim 46 wherein

the second results screen is associated with a query by example screen input to receive a user indication of desire receive one or more results representations that are similar to one or more user-indicated results representations displayed by the second results screen.

52. The computer user interface screen system of claim 46 wherein

the second results screen is associated with a query by example screen input to receive a user indication of desire receive one or more results representations that are similar to one or more user-indicated results representations displayed by the second results screen;

and

the query by example screen input includes feature input to receive a user indication as to one or more features of the one or more additional sample representations are to match corresponding features of the at least one current sample representation.

53. The computer user interface screen system of claim 47 wherein

the third results screen is associated with a query by example screen input to receive a user indication of desire receive one or more results representations that are similar to one or more user-indicated results representations displayed by the third results screen.

54. The computer user interface screen system of claim 47 wherein,

the third results screen is associated with a query by example screen input to receive a user indication of desire receive one or more results representations that are similar to one or more user-indicated results representations displayed by the third results screen;

and

the query by example screen input includes feature input to receive a user indication as to one or more features of the one or more additional sample representations are to match corresponding features of the at least one current sample representation.

55. The computer user interface screen system of claim 33 wherein,

respective individual sample representations of the first and second sets of multiple possible query sample representations are respectively characterized by a plurality of features from a feature space;

and

respective the samples of the first set of multiple possible query sample representations are well separated from each other in the feature space; and

respective the samples of the second set of multiple possible query sample representations are well separated from each other in the feature space.

56. The computer user interface screen system of claim 34 wherein,

respective individual sample representations of the first, second and third sets of multiple possible query sample representations are respectively characterized by a plurality of features from a feature space;

and

respective the samples of the first set of multiple possible query sample representations are well separated from each other in the feature space;

respective the samples of the second set of multiple possible query sample representations are well separated from each other in the feature space; and

respective the samples of the third set of multiple possible query sample representations are well separated from each other in the feature space.

57. The computer user interface screen system of claim 35 wherein,

respective individual sample representations of the first, second, third and fourth sets of multiple possible query sample representations are respectively characterized by a plurality of features from a feature space;

and

respective the samples of the first set of multiple possible query sample representations are well separated from each other in the feature space;

respective the samples of the second set of multiple possible query sample representations are well separated from each other in the feature space;

respective the samples of the third set of multiple possible query sample representations are well separated from each other in the feature space; and

respective the samples of the fourth set of multiple possible query sample representations are well separated from each other in the feature space.

58. The computer user interface screen system of claim 35 wherein,

the feature space includes color, texture and shape.

60. A computer readable storage medium encoded with a computer program that functions to produce the computer user interface screen of claim 33, 34, 35, 45, 46, 47, 49, 51, 53, 55, 56 or 59.