System and method for determining quality of cited objects in search results based on the influence of citing subjects

• US 20120239637A9
• Filed: 06/13/2011
• Published: 09/20/2012
• Est. Priority Date: 12/01/2009
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Prakash, Vipul Ved, Cui, Lun Ted, Ghosh, Rishab Aiyer, Emerson, Thomas James
• Granted Patent: US 11,036,810 B2
• Time in Patent Office: Days
• US Class Current: 707/707
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results

Abstract

A new approach is proposed that contemplates systems and methods to examine and determine quality of objects cited by citations in a search result based on a citation graph that includes citing subjects, citations, and cited objects. First, influence scores of a plurality of subjects/sources that compose the citations of the objects in the search result are calculated. The quality of the objects cited by the subjects can then be determined by examining the influence scores for the subjects of the citations. Finally, the cited objects selected can be presented to a user or provided to a thirty party for further processing together with the relevant citations and citing subjects.

Claims

1. A system, comprising:

a citation search engine, which in operation,

sets and adjusts one or more of citation searching and ranking criteria and mechanisms based on user specification and/or internal statistical data;

retrieves a plurality of citations composed by a plurality of subjects citing a plurality of objects that fit the searching criteria;

an influence evaluation engine, which in operation, calculates influence scores of the plurality of subjects that compose the plurality of citations citing the plurality of objects;

an object selection engine, which in operation,

calculates influence scores of the plurality of objects in the plurality of citations based on the influence scores of the plurality of subjects and the ranking criteria;

selects as a search result the plurality of objects based on both matching of the objects with the searching criteria as well as the influence scores of the objects.

2. The system of claim 1, wherein:

each of the plurality of subjects has an opinion wherein expression of the opinion is explicit, expressed, implicit, or imputed through any other technique.

3. The system of claim 1, wherein:

each of the plurality of subjects is one of;

representation of a person, web log, and entities representing Internet authors or users of social media services, user of microblogging services, users of social networks, reviewer who provides expressions of opinion, reviews, or other information useful for the estimation of influence.

4. The system of claim 1, wherein:

each of the plurality of objects is one of;

Internet web sites, blogs, videos, books, films, music, image, video, documents, data files, objects for sale, objects that are reviewed or recommended or cited, subjects/authors, natural or legal persons, citations, or any entities that are associated with a Uniform Resource Identifier (URI).

5. The system of claim 1, wherein:

each of the plurality of citations includes one or more of;

expression of opinions on the objects, expressions of authors in the form of Tweets, blog posts, reviews of objects on Internet web sites Wikipedia entries, postings to social media, postings to websites, postings in the form of reviews, recommendations, or any other form of citation made to mailing lists, newsgroups, discussion forums, comments to websites or any other form of Internet publication.

6. The system of claim 1, wherein:

each of the plurality of citations is made by a subject regarding an object, a subject regarding another subject, or an object regarding another object.

7. The system of claim 1, wherein:

the citation search engine enables a citation centric search process that focuses on influence of the plurality subjects that cite the plurality of objects.

8. The system of claim 1, wherein:

the citation search engine accepts and enforces a plurality of criteria on citation searching, retrieving and ranking, each of which is either be explicitly described by a user or best guessed by the system based on internal statistical data.

9. The system of claim 8, wherein:

the plurality of criteria include one or more of constraints for the plurality of citations, type of the plurality of objects cited, and ranking bias of the cited objects.

10. The system of claim 1, wherein:

the influence score of each of the plurality of subjects indicates degree to which the subject'"'"'s opinion influences other subjects and/or a community of subjects.

11. The system of claim 1, wherein:

the influence score of each of the plurality of objects indicates collective opinions of the plurality of subjects citing the object.

12. The system of claim 1, wherein:

some of the plurality of subjects are related to each other via an influence network or community.

13. The system of claim 12, wherein:

the influence evaluation engine calculates the influence scores of the plurality of subjects based on their authorities in the influence network.

14. The system of claim 1, wherein:

the influence evaluation engine calculates the influence scores of the plurality of subjects on one or more dimensions that are related to one or more of the objects cited by the subjects, form of the citations, and search terms.

15. The system of claim 1, wherein:

the influence evaluation engine determines an influence score for a first subject in the plurality of subjects at least partly based on how often the first subject is cited or referenced by one or more second subjects in the plurality of subjects.

16. The system of claim 15, wherein:

each of the one or more second objects references a citation of an object by the first subject.

17. The system of claim 15, wherein:

the influence evaluation engine computes the number of the citations of the first subject by the second subjects as the citation score and takes into account the influence of the second subjects citing the first subject in the citation score.

18. The system of claim 1, wherein:

the influence evaluation engine calculates the influence scores of the plurality of subjects based on a citation graph having the plurality of subjects and the plurality of objects as its entities and the plurality of citations as its edges.

19. The system of claim 18, wherein:

the influence evaluation engine allows for attribution of influence on the plurality of subjects to data sources to be estimated and distributed based on the citation graph.

20. The system of claim 18, wherein:

the influence evaluation engine estimates the influence score of each entity from one or more of count of actual requests for data, opinion, or searches relating to or originating from other entities, entities with direct links to the entity or with a path in the citation graph.

21. The system of claim 18, wherein:

the influence evaluation engine adjusts the influence score of each entity in the citation graph by metrics relating to the citation graph comprising all entities or a subset of all linked entities in the citation graph.

22. The system of claim 1, wherein:

the ranking criteria include one or more of;

influence scores of the citing subjects, date or time, and geographical location associated with the objects.

23. The system of claim 1, wherein:

the object selection engine determines qualities of the cited objects by examining the distribution of the influence scores of the subjects citing the objects in the search results.

24. The system of claim 23, wherein:

one measure of the influence distribution is the citation ratio of the number of citations from influential and non-influential subjects.

25. The system of claim 23, wherein:

the object selection engine accepts only those objects that show up in the search results if their citation ratios from influential and non-influential subjects are above a certain threshold while others can be marked as spam if the ratio of their citation ratios from the influential and non-influential subjects fall below the certain threshold.

26. The system of claim 1, wherein:

the object selection engine calculates and ranks the plurality of objects by treating citations of the objects as connections having positive or negative scores in the weighted citation graph.

27. The system of claim 26, wherein:

the object selection engine propagates negative citation scores through the citation graph to identify one or more spammers and to reduce their influence on the search result.

28. The system of claim 1, wherein:

the object selection engine presents the search results of cited objects to a user who issues the search request or provides the generated search results to a third party for further processing.

29. The system of claim 28, wherein:

the object selection engine presents to the user a score computed from a function combining the count of citations and the influence of the subjects of the citations along with the search result of the objects.

30. The system of claim 28, wherein:

the object selection engine selects for display of every object in the search result, one or more citations and the subjects of the citations on the basis of criteria such as the recency or the influence of their citing subjects relative to the other citations in the search result.

31. The system of claim 30, wherein:

the object selection engine displays the selected citations and/or subjects in such a way that the relationship between the search result, the citations and the subjects of the citations are made transparent to a user.

32. A method, comprising:

setting and adjusting one or more of citation searching, retrieving, and ranking criteria and mechanisms based on user specification and/or internal statistical data;

retrieving a plurality of citations composed by a plurality of subjects citing a plurality of objects that fit the searching criteria;

calculating influence scores of the plurality of subjects that compose the plurality of citations citing the plurality of objects;

calculating influence scores of the plurality of objects in the plurality of citations based on the influence scores of the plurality of subjects and the ranking criteria;

selecting as a search result the plurality of objects based on both matching of the objects with the searching criteria as well as the influence scores of the objects.

33. The method of claim 32, further comprising:

enabling a citation centric search process that focuses on influence of the plurality subjects that cite the plurality of objects.

34. The method of claim 32, further comprising:

accepting and enforcing a plurality of criteria on citation searching, retrieving and ranking, each of which is either be explicitly described by a user or best guessed by the system based on internal statistical data.

35. The method of claim 32, further comprising:

calculating the influence scores of the plurality of subjects based on their authorities in an influence network.

36. The method of claim 32, further comprising:

calculating the influence scores of the plurality of subjects on one or more dimensions that are related to one or more of the objects cited by the subjects, form of the citations, and search terms.

37. The method of claim 32, further comprising:

determining an influence score for a first subject in the plurality of subjects at least partly based on how often the first subject is cited or referenced by one or more second subjects in the plurality of subjects.

38. The method of claim 37, further comprising:

computing the number of the citations of the first subject by the second subjects as the citation score and takes into account the influence of the second subjects citing the first subject in the citation score.

39. The method of claim 32, further comprising:

calculating the influence scores of the plurality of subjects based on a citation graph having the plurality of subjects and the plurality of objects as its entities and the plurality of citations as its edges.

40. The method of claim 39, further comprising:

determining the influence scores for each entity within the citation graph on a specific given dimension.

41. The method of claim 39, further comprising:

estimating the influence score of each entity from one or more of count of actual requests for data, opinion, or searches relating to or originating from other entities, entities with direct links to the entity or with a path in the citation graph.

42. The method of claim 39, further comprising:

adjusting the influence score of each entity in the citation graph by metrics relating to the citation graph comprising all entities or a subset of all linked entities in the citation graph.

43. The method of claim 32, further comprising:

determining qualities of the cited objects by examining the distribution of the influence scores of the subjects citing the objects in the search results.

44. The method of claim 43, further comprising:

accepting only those objects that show up in the search results if their citation ratios from influential and non-influential subjects are above a certain threshold while others can be marked as spam if the ratio of their citation ratios from the influential and non-influential subjects fall below the certain threshold.

45. The method of claim 32, further comprising:

calculating and ranking the plurality of objects by treating citations of the objects as connections having positive or negative scores in the weighted citation graph.

46. The method of claim 45, further comprising:

propagating negative citation scores through the citation graph to identify one or more spammers and to reduce their influence on the search result.

47. The method of claim 32, further comprising:

presenting the search results of cited objects to a user who issues the search request or provides the generated search results to a third party for further processing.

48. The method of claim 47, further comprising:

presenting to the user a score computed from a function combining the count of citations and the influence of the subjects of the citations along with the search result of the objects.

49. The method of claim 47, further comprising:

selecting for display of every object in the search result, one or more citations and the subjects of the citations on the basis of criteria such as the recency or the influence of their citing subjects relative to the other citations in the search result.

50. The method of claim 49, further comprising:

displaying the selected citations and/or subjects in such a way that the relationship between the search result, the citations and the subjects of the citations are made transparent to a user.