Method and system for determining interest spaces among online content sources

• US 7,860,895 B1
• Filed: 12/29/2005
• Issued: 12/28/2010
• Est. Priority Date: 08/23/2005
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Scofield, Christopher L., Pope, Elmore Eugene, Marshall, Brad E.
• Primary Examiner(s): Vital; Pierre M
• Assistant Examiner(s): Nguyen; Loan T
• Application Number:
  US11/321,895
• Time in Patent Office: 1,825 Days
• Field of Search: None
• US Class Current: 707/802
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A method and system for determining interest spaces among online content sources. According to one embodiment, a method may include generating a representation of a network of online content sources, where the representation reflects navigation paths and respective navigation path weights among the online content sources, and where the navigation path weights are indicative of user activity among the online content sources. The method may further include generating one or more interest spaces of the network dependent upon the navigation paths and respective navigation path weights, where each interest space includes at least a subset of the online content sources.

Claims

1. A computer-implemented method, comprising:

generating a representation of a network of online content sources, wherein said representation reflects navigation paths and respective navigation path weights among said online content sources, wherein different values of said navigation path weights are indicative of corresponding different levels of user activity among said online content sources, and wherein said user activity comprises a plurality of requests generated by a plurality of users to access individual ones of said online content sources; and

dependent upon said navigation paths and respective navigation path weights, generating one or more interest spaces of said network, wherein each interest space includes at least a subset of said online content sources;

wherein generating any particular one of said one or more interest spaces comprises;

selecting a given one of said online content sources for inclusion in said particular interest space dependent upon user activity between said given online content source and some other online content source that is currently included in said particular interest space, wherein said user activity is indicated by one or more of said navigation paths and respective navigation path weights corresponding to said given online content source, and wherein selecting said given online content source for inclusion in said particular interest space occurs without dependence upon content included in said given online content source;

wherein said selecting comprises determining whether a given navigation path relating said given online content source and said other online content source is a qualifying navigation path, and if said given navigation path is a qualifying navigation path, assigning said given online content source to said given interest space;

wherein said determining whether said given navigation path is a qualifying navigation path includes determining whether a given navigation path weight corresponding to said given navigation path satisfies a selection criterion;

wherein each of said generating a representation, said generating one or more interest spaces, and said generating a particular interest space is performed by one or more computer systems each comprising at least a processor and a memory.

2. The method as recited in claim 1, wherein said selection criterion specifies a minimum navigation path weight, and wherein said determining whether said given navigation path weight corresponding to said given navigation path satisfies said selection criterion includes determining whether said given navigation path weight is greater than said minimum navigation path weight.

3. The method as recited in claim 1, wherein for a given one of said one or more interest spaces, generating said given interest space includes determining whether a given navigation path relating a first online content source and a second online content source is a qualifying navigation path, wherein said first online content source is a member of said given interest space, and if said given navigation path is a qualifying navigation path, assigning said second online content source to said given interest space.

4. The method as recited in claim 1, further comprising identifying an aggregate path within a given one of said interest spaces, wherein said aggregate path includes one or more of said navigation paths among online content sources within said given interest space.

5. The method as recited in claim 4, wherein an aggregate path weight corresponding to said identified aggregate path satisfies an optimization criterion relative to a set of possible aggregate paths within said given interest space.

6. The method as recited in claim 1, wherein a given one of said navigation paths corresponds to a first and a second online content source, wherein said first online content source includes an explicit navigation reference to said second online content source.

7. The method as recited in claim 6, wherein each of said first and said second online content sources corresponds to a respective web page, and wherein said explicit navigation reference corresponds to a navigation link encoded within said first online content source.

8. The method as recited in claim 6, further comprising determining that said given navigation path between said first and said second online content sources exists in response to detecting a content access request directed to said second online content source, wherein said content access request indicates that said first online content source is a referrer of said content access request.

9. The method as recited in claim 6, further comprising determining that said given navigation path between said first and said second online content sources exists in response to detecting said explicit navigation references within said first online content source independent of a content access request directed to either said first or said second online content source.

10. The method as recited in claim 1, wherein each of said respective navigation path weights corresponds to a time rate of change of a rate at which users traverse said corresponding navigation path.

11. The method as recited in claim 10, further comprising determining said time rate of change dependent upon numerically computing a first derivative with respect to time of a time series of data points corresponding to said users traversing said corresponding navigation path.

12. The method as recited in claim 1, wherein a topology of said navigation paths among said plurality of online content sources differs from a topology of explicit navigation links included among said plurality of online content sources.

13. The method as recited in claim 1, wherein a topology of said navigation paths among said plurality of online content sources differs from a topology of communication paths among systems configured to implement said plurality of online content sources.

14. A computer-accessible storage medium storing instructions, wherein the instructions are executable to:

generate a representation of a network of online content sources, wherein said representation reflects navigation paths and respective navigation path weights among said online content sources, wherein different values of said navigation path weights are indicative of corresponding different levels of user activity among said online content sources, and wherein said user activity comprises a plurality of requests generated by a plurality of users to access individual ones of said online content sources; and

dependent upon said navigation paths and respective navigation path weights, generate one or more interest spaces of said network, wherein each interest space includes at least a subset of said online content sources;

wherein to generate any particular one of said one or more interest spaces, the instructions are further executable to;

select a given one of said online content sources for inclusion in said particular interest space dependent upon user activity between said given online content source and some other online content source that is currently included in said particular interest space, wherein said user activity is indicated by one or more of said navigation paths and respective navigation path weights corresponding to said given online content source, and wherein selecting said given online content source for inclusion in said particular interest space occurs without dependence upon content included in said given online content source;

wherein said selecting comprises determining whether a given navigation path relating said given online content source and said other online content source is a qualifying navigation path, and if said given navigation path is a qualifying navigation path, assigning said given online content source to said given interest space;

wherein said determining whether said given navigation path is a qualifying navigation path includes determining whether a given navigation path weight corresponding to said given navigation path satisfies a selection criterion.

15. The computer-accessible storage medium as recited in claim 14, wherein said selection criterion specifies a minimum navigation path weight, and wherein said determining whether said given navigation path weight corresponding to said given navigation path satisfies said selection criterion includes determining whether said given navigation path weight is greater than said minimum navigation path weight.

16. The computer-accessible storage medium as recited in claim 14, wherein for a given one of said one or more interest spaces, generating said given interest space includes determining whether a given navigation path relating a first online content source and a second online content source is a qualifying navigation path, wherein said first online content source is a member of said given interest space, and if said given navigation path is a qualifying navigation path, assigning said second online content source to said given interest space.

17. The computer-accessible storage medium as recited in claim 14, wherein the instructions are further executable to identify an aggregate path within a given one of said interest spaces, wherein said aggregate path includes one or more of said navigation paths among online content sources within said given interest space.

18. The computer-accessible storage medium as recited in claim 17, wherein an aggregate path weight corresponding to said identified aggregate path satisfies an optimization criterion relative to a set of possible aggregate paths within said given interest space.

19. The computer-accessible storage medium as recited in claim 14, wherein a given one of said navigation paths corresponds to a first and a second online content source, wherein said first online content source includes an explicit navigation reference to said second online content source.

20. The computer-accessible storage medium as recited in claim 19, wherein each of said first and said second online content sources corresponds to a respective web page, and wherein said explicit navigation reference corresponds to a navigation link encoded within said first online content source.

21. The computer-accessible storage medium as recited in claim 19, wherein the instructions are further executable to determine that said given navigation path between said first and said second online content sources exists in response to detecting a content access request directed to said second online content source, wherein said content access request indicates that said first online content source is a referrer of said content access request.

22. The computer-accessible storage medium as recited in claim 19, wherein the instructions are further executable to determine that said given navigation path between said first and said second online content sources exists in response to detecting said explicit navigation references within said first online content source independent of a content access request directed to either said first or said second online content source.

23. The computer-accessible storage medium as recited in claim 14, wherein each of said respective navigation path weights corresponds to a time rate of change of a rate at which users traverse said corresponding navigation path.

24. The computer-accessible storage medium as recited in claim 23, wherein the instructions are further executable to determine said time rate of change dependent upon numerically computing a first derivative with respect to time of a time series of data points corresponding to said users traversing said corresponding navigation path.

25. The computer-accessible storage medium as recited in claim 14, wherein a topology of said navigation paths among said plurality of online content sources differs from a topology of explicit navigation links included among said plurality of online content sources.

26. The computer-accessible storage medium as recited in claim 14, wherein a topology of said navigation paths among said plurality of online content sources differs from a topology of communication paths among systems configured to implement said plurality of online content sources.

27. A system, comprising one or more computers configured to execute program instructions, wherein the program instructions are executable by at least one of the one or more computers systems to implement:

a web services interface configured to receive, according to a web services protocol, indications of navigation traffic directed to respective ones of a plurality of online content sources; and

a traffic analysis engine configured to receive said indications from said web services interface and to;

generate a representation of a network of said online content sources, wherein said representation reflects navigation paths and respective navigation path weights among said online content sources according to said indications of navigation traffic, wherein different values of said navigation path weights are indicative of corresponding different levels of user activity among said online content sources, and wherein said user activity comprises a plurality of requests generated by a plurality of users to access individual ones of said online content sources; and

dependent upon said navigation paths and respective navigation path weights, generate one or more interest spaces of said network, wherein each interest space includes at least a subset of said online content sources;

wherein to generate any particular one of said one or more interest spaces, the traffic analysis engine is further configured to;

select a given one of said online content sources for inclusion in said particular interest space dependent upon user activity between said given online content source and some other online content source that is currently included in said particular interest space, wherein said user activity is indicated by one or more of said navigation paths and respective navigation path weights corresponding to said given online content source, and wherein selecting said given online content source for inclusion in said particular interest space occurs without dependence upon content included in said given online content source;

wherein said selecting comprises determining whether a given navigation path relating said given online content source and said other online content source is a qualifying navigation path, and if said given navigation path is a qualifying navigation path, assigning said given online content source to said given interest space;

wherein said determining whether said given navigation path is a qualifying navigation path includes determining whether a given navigation path weight corresponding to said given navigation path satisfies a selection criterion.

28. The system as recited in claim 27, wherein said selection criterion specifies a minimum navigation path weight, and wherein to determine whether said given navigation path weight corresponding to said given navigation path satisfies said selection criterion, said traffic analysis engine is further configured to determine whether said given navigation path weight is greater than said minimum navigation path weight.

29. The system as recited in claim 27, wherein for a given one of said one or more interest spaces, to generate said given interest space, said traffic analysis engine is further configured to determine whether a given navigation path relating a first online content source and a second online content source is a qualifying navigation path, wherein said first online content source is a member of said given interest space, and if said given navigation path is a qualifying navigation path, to assign said second online content source to said given interest space.

30. The system as recited in claim 27, wherein said traffic analysis engine is further configured to identify an aggregate path within a given one of said interest spaces, wherein said aggregate path includes one or more of said navigation paths among online content sources within said given interest space.

31. The system as recited in claim 30, wherein an aggregate path weight corresponding to said identified aggregate path satisfies an optimization criterion relative to a set of possible aggregate paths within said given interest space.

32. The system as recited in claim 27, wherein a given one of said navigation paths corresponds to a first and a second online content source, wherein said first online content source includes an explicit navigation reference to said second online content source.

33. The system as recited in claim 32, wherein each of said first and said second online content sources corresponds to a respective web page, and wherein said explicit navigation reference corresponds to a navigation link encoded within said first online content source.

34. The system as recited in claim 32, wherein said traffic analysis engine is further configured to determine that said given navigation path between said first and said second online content sources exists in response to detecting a content access request directed to said second online content source, wherein said content access request indicates that said first online content source is a referrer of said content access request.

35. The system as recited in claim 32, wherein said traffic analysis engine is further configured to determine that said given navigation path between said first and said second online content sources exists in response to detecting said explicit navigation references within said first online content source independent of a content access request directed to either said first or said second online content source.

36. The system as recited in claim 27, wherein each of said respective navigation path weights corresponds to a time rate of change of a rate at which users traverse said corresponding navigation path.

37. The system as recited in claim 36, wherein said traffic analysis engine is further configured to determine said time rate of change dependent upon numerically computing a first derivative with respect to time of a time series of data points corresponding to said users traversing said corresponding navigation path.

38. The system as recited in claim 27, wherein a topology of said navigation paths among said plurality of online content sources differs from a topology of explicit navigation links included among said plurality of online content sources.

39. The system as recited in claim 27, wherein a topology of said navigation paths among said plurality of online content sources differs from a topology of communication paths among systems configured to implement said plurality of online content sources.