Method for providing a substitute for a requested inaccessible object by identifying substantially similar objects using weights corresponding to object features

• US 5,941,944 A
• Filed: 03/03/1997
• Issued: 08/24/1999
• Est. Priority Date: 03/03/1997
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Messerly, John J.
• Primary Examiner(s): Maung, Zarni
• Assistant Examiner(s): CALDWELL, ANDREW T
• Application Number:
  US08/828,813
• Time in Patent Office: 904 Days
• Field of Search: 707/3-5, 707/10, 707/104, 707/501, 707/513, 709/200, 709/203, 709/217-219
• US Class Current: 709/203
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 16/9574 of access to content, e.g. by caching
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access

Abstract

Weights are assigned to features of data objects and the weights are utilized to determine whether data objects are substantially identical or not. One application of such weights is to assign weights to terms in web page documents. The weights assigned to the terms may then be utilized to determine whether web page documents are substantially identical. A set of identicals may be generated for each web page that is indexed by the system and utilized to repair broken hyperlinks. Specifically, when a uniform resource locator (URL) associated with the hyperlink cannot be resolved or cannot be resolved in a timely fashion, one of the identicals of the desired web page documents may be returned to provide a requesting party with the desired content.

Claims

1. In a computer system, a method comprising computer-implemented steps of:

obtaining a first plurality of weights for a first plurality of features of a first data object and a second plurality of weights for a second plurality of features of a second data object, each of said weights being associated with a corresponding one of the features in the first or second pluralities of features, wherein said each weight quantitatively specifies an amount by which the corresponding one feature distinguishes an associated data object from other data objects contained within a collection of data objects;

comparing a first weight for a selected one of the features of the first data object with a second weight for the selected one feature of the second data object so as to determine whether the first and second data objects are substantially identical; and

if the first and second data objects are substantially identical, accessing the second data object, in response to a request emanating from a requesting party for the first data object, when the first data object cannot be accessed in a predefined manner by the requesting party.

2. The method of claim 1 further comprising the step of returning, in response to the request, the second data object to the requesting party.

3. The method of claim 1 further comprising the step of determining that the first and second data objects are not substantially identical when values of the first and second weights are not substantially similar to each other.

4. The method of claim 1 wherein the comparing step comprises the step of comparing additional corresponding ones of the weights in the first and second pluralities of weights for additional associated ones of the features of said first and second data objects, respectively.

5. The method of claim 4 wherein the first and second data objects are substantially identical only if values of the first and second weights equal each other.

6. The method of claim 4 wherein the comparing step comprises the step of determining that the first and second data objects are not substantially identical when values of the first and second weights are not substantially similar to each other.

7. The method of claim 1 wherein either one of the first and the second data objects is located on an Internet or intranet server.

8. The method of claim 1 further comprising the step of determining each of said weights.

9. The method of claim 1 wherein the computer system is a distributed system having an network operating system and wherein each of the first data and second objects is a resource, in the distributed system, accessible via the network operating system.

10. In a computer system having access to web pages, a method comprising computer-implemented steps of:

obtaining a first plurality of weights for a first plurality of terms of a first web page and a second plurality of weights for a second plurality of terms of a second web page, each of said weights being associated with a corresponding one of the terms in the first or second pluralities of terms, wherein said each weight quantitatively specifies an amount by which the corresponding one term distinguishes an associated web page from other web pages contained within a collection of web pages;

comparing a first weight for a selected one of the terms of the first web page with a second weight for the selected one term of the second web page so as to determine whether the first and second web pages are substantially identical; and

if the first and second web pages are substantially identical, accessing the second web page, in response to a request emanating from a requesting party for the first web page, when the first web page cannot be accessed in a predefined manner by the requesting party.

11. The method of claim 10 wherein the request comprises a uniform resource locator (URL) for the first web page.

12. The method of claim 11 wherein the first web page cannot be accessed because the URL in the request is not valid for the first web page.

13. The method of claim 10 further comprising the step of returning, in response to the request, the second web page to the requesting party.

14. The method of claim 10 further comprising the step of determining that the first and second web pages are not substantially identical when values of the first and second weights are not substantially similar to each other.

15. The method of claim 10 wherein the comparing step comprises the step of comparing additional corresponding ones of the weights in the first and second pluralities of weights for additional associated ones of the terms of said first and second web pages, respectively.

16. The method of claim 10 wherein either the first or second web page is located on an Internet or intranet server.

17. The method of claim 10 wherein the method further comprises the step of determining each of the weights.

18. The method of claim 10 further comprising the step of storing the weights in the first and second pluralities in an index of web pages that indexes terms within web pages.

19. The method of claim 10 wherein the comparing step comprises the step of determining that the first and second web pages are not substantially identical when values of the first and second weights are not substantially similar to each other.

20. In a computer system, a method comprising the steps of:

providing a hypertext document having a hyperlink to a first web page holding media content;

in response to a party selecting the hyperlink, attempting to access the first web page so as to define an access attempt; and

if the access attempt is unsuccessful, identifying a second web page, holding substantially identical media content to the media content in said first web page, through the steps of;

obtaining a first plurality of weights for a first plurality of features of the media content in the first web page and a second plurality of weights for a second plurality of features of the media content in the second web page, each of said weights being associated with a corresponding feature, in the first or second pluralities of features, of the media content in either the first or second web pages, wherein said each weight quantitatively specifies an amount by which the corresponding one feature distinguishes the associated media content in either the first or second web pages from media content contained within a collection of other web pages; and

comparing a first weight for a selected one of the features of the media content in the first web page with a second weight for the selected one feature of the media content in the second web page so as to determine whether the media content in the first and second web pages is substantially identical; and

where the access attempt is unsuccessful and the media content in the first and second web pages is substantially identical;

accessing the media content in the second web page; and

returning the media content in the second web page to the party which selected the hyperlink to the first web page.

21. The method of claim 20 wherein the media content in the first web page comprises text.

22. The method of claim 20 wherein the hyperlink comprises information specifying a network location of the first web site and wherein the access attempt is not successful because the information is incorrect.

23. The method of claim 20 wherein the access attempt is not successful because a predetermined time interval has elapsed since the request was initiated but before the first web site could be accessed.

24. The method of claim 20 wherein the identifying, accessing and returning steps all occur substantially transparently to the party.

25. In a computer system, a method comprising the computer-implemented steps of:

calculating first and second word weights for a selected term within a first document and for the selected term within a second document, respectively, by;

(i) calculating a collection frequency component that identifies how often the selected term appears within documents in a collection of documents;

(ii) calculating first and second term frequency components for the first and second documents equal to a number of times that the selected term appears within the first and second documents, respectively; and

(iii) calculating first and second products of the collection frequency component and the first and second term frequency components, respectively, and normalizing the first and second products to respectively produces the first and second word weights;

comparing the first word weight with the second word weight so as to determine whether the first and second documents are substantially identical; and

if the first and second documents are substantially identical, accessing the second document, in response to a request emanating from a requesting party to access the first document, when the first document can not be accessed in a predefined manner by the requesting party.

26. The method of claim 25 wherein the first and second documents are first and second web pages, respectively.

27. The method of claim 25 further comprising the step of returning, in response to the request, the second document to the requesting party.

28. For use with a computer system, a computer-readable medium storing computer-executable instructions for performing a method comprising the computer-implemented steps of:

obtaining a first plurality of weights for a first plurality of features of a first data object and a second plurality of weights for a second plurality of features of a second data object, each of said weights being associated with a corresponding one of the features in the first and second pluralities of features, wherein said each weight quantitatively specifies an amount by which the corresponding one feature distinguishes an associated data object from other data objects contained within a collection of data objects;

comparing a first weight for a selected one of the features of the first data object with a second weight for the selected one feature of the second data object so as to determine whether the first and second data objects are substantially identical; and

if the first and second data objects are substantially identical, accessing the second data object, in response to a request emanating from a requesting party for the first data object, when the first data object cannot be accessed in a predefined manner by the requesting party.

29. The computer-readable medium of claim 28 wherein the computer executable instructions further comprise instructions for performing the step of returning, in response to the request, the second data object to the requesting party.

30. The computer-readable medium of claim 28 wherein the computer executable instructions further comprise instructions for performing, in the comparing step, the step of comparing additional corresponding ones of the weights in the first and second pluralities of weights for additional associated ones of the features of said first and second data objects, respectively.

31. The computer-readable medium of claim 28 wherein the first and second data objects are substantially identical only if values of the first and second weights equal each other.

32. The computer-readable medium of claim 28 wherein the computer executable instructions further comprise instructions for performing the step of determining each of said weights.

33. The computer-readable medium of claim 28 wherein the computer executable instructions further comprise instructions for performing the step of determining that the first and second data objects are not substantially identical when values of the first and second weights are not substantially similar to each other.

34. For use with a computer system having access to web pages, a computer-readable medium storing computer-executable instructions for performing a method comprising the computer-implemented steps of:

obtaining a first plurality of weights for a first plurality of terms of a first web page and a second plurality of weights for a second plurality of terms of a second web page, each of said weights being associated with a corresponding one of the terms in the first or second pluralities of terms, wherein said each weight quantitatively specifies an amount by which the corresponding one term distinguishes an associated web page from other web pages contained within a collection of web pages;

comparing a first weight for a selected one of the terms of the first web page with a second weight for the selected one term of the second web page so as to determine whether the first and second web pages are substantially identical; and

if the first and second web pages are substantially identical, accessing the second web page, in response to a request emanating from a requesting party for the first web page, when the first web page cannot be accessed in a predefined manner by the requesting party.

35. The computer-readable medium of claim 34 wherein the request comprises a uniform resource locator (URL) for the first web page.

36. The computer-readable medium of claim 35 wherein the first web page cannot be accessed because the URL in the request is not valid for the first web page.

37. The computer-readable medium of claim 34 wherein the computer executable instructions further comprise instructions for performing the step of returning, in response to the request, the second web page to the requesting party.

38. The computer-readable medium of claim 34 wherein the computer executable instructions further comprise instructions for performing the step of comparing additional corresponding ones of the weights in the first arid second pluralities of weights for additional associated ones of the terms of said first and second web pages, respectively.

39. The computer-readable medium of claim 34 wherein the computer executable instructions further comprise instructions for performing the step of determining each of the weights.

40. The computer-readable medium of claim 34 wherein the computer executable instructions further comprise instructions for performing the step of storing the weights in the first and second pluralities in an index of web pages that indexes terms within web pages.

41. The computer-readable medium of claim 34 wherein the computer executable instructions further comprise instructions for performing the step of determining that the first and second web pages are not substantially identical when values of the first and second weights are not substantially similar to each other.

42. For use with a computer system, a computer-readable medium storing computer-executable instructions for performing a method comprising the computer-implemented steps of:

providing a hypertext document having a hyperlink to a first web page holding media content;

in response to a party selecting the hyperlink, attempting to access the first web page so as to define an access attempt; and

if the access attempt is unsuccessful, identifying a second web page, holding substantially identical media content to the media content in said first web page, through the steps of;

obtaining a first plurality of weights for a first plurality of features of the media content in the first web page and a second plurality of weights for a second plurality of features of the media content in the second web page, each of said weights being associated with a corresponding feature, in the first or second pluralities of features, of the media content in either the first or second web pages, wherein said each weight quantitatively specifies an amount by which the corresponding one feature distinguishes the associated media content in either the first or second web page from media content contained within a collection of other web pages; and

comparing a first weight for a selected one of the features of the media content in the first web page with a second weight for the selected one feature of the media content in the second web page so as to determine whether the media content in the first and second web pages is substantially identical; and

where the access attempt is unsuccessful and the media content in the first and second web pages is substantially identical;

accessing the media content in the second web page; and

returning the media content in the second web page to the party which selected the hyperlink to the first web page.

43. The computer-readable medium of claim 42 wherein the hyperlink comprises information specifying a network location of the first web site and wherein the access attempt is not successful because the information is incorrect.

44. The computer-readable medium of claim 42 wherein the access attempt is not successful because a predetermined time interval has elapsed since the request was initiated but before the first web site could be accessed.

45. For use with a computer system, a computer-readable medium storing computer-executable instructions for performing a method comprising the computer-implemented steps of:

calculating first and second word weights for a selected term within a first document and for the selected term within a second document, respectively, by;

(i) calculating a collection frequency component that identifies how often the selected term appears within documents in a collection of documents;

(ii) calculating first and second term frequency components for the first and second documents equal to a number of times that the selected term appears within the first and second documents, respectively; and

(iii) calculating first and second products of the collection frequency component and the first and second term frequency components, respectively, and normalizing the first and second products to respectively produce the first and second word weights;

comparing the first word weight with the second word weight so as to determine whether the first and second documents are substantially identical; and

if the first and second documents are substantially identical, accessing the second document, in response to a request emanating from a requesting party to access the first document, when the first document can not be accessed in a predefined manner by the requesting party.

46. The computer-readable medium of claim 45 wherein the first and second documents are first and second web pages, respectively.

47. The computer-readable medium of claim 45 wherein the computer executable instructions further comprise instructions for performing the step of returning, in response to the request, the second document to the requesting party.