Internet profile service

• US 9,742,723 B2
• Filed: 03/21/2016
• Issued: 08/22/2017
• Est. Priority Date: 04/22/2009
• Status: Active Grant

• Current Assignee: VeriSign, Inc.
• Original Assignee: VeriSign, Inc.
• Inventors: Orentas, Leonard Linas, Kosters, Mark Alan, Moston, David, Shyamsunder, Karthik, Sunkara, Srinivas, Jimenez, Eduardo, Pattapu, Venkata, Holmes, Alexander, Simpson, Andrew
• Primary Examiner(s): Nguyen, Dustin
• Assistant Examiner(s): Mesa, Joel
• Application Number:
  US15/075,973
• Publication Number:
  US 20160277354A1
• Time in Patent Office: 519 Days
• Field of Search: 709224, 709223
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9566 URL specific, e.g. using aliases, detecting broken or misspelled links
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 43/08 Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
• CPC Class Codes: H04L 61/4511 using domain name system [DNS]
• CPC Class Codes: H04L 61/5007 Internet protocol [IP] addresses
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/30 Profiles

Abstract

Systems and methods for creating and using a domain profile include identifying a status of a first page associated with a domain. The first page is retrieved and additional pages from the domain are identified based on hyperlinks from the first page. The status of the additional pages is identified and the hyperlinks are prioritized based on the status and/or a comparison with predetermined data. Content is extracted from the first page and selected pages from among the additional pages. The specific additional pages may be selected based on the prioritization. The retrieved content may be processed through a signature marker set to determine a contextual match. A purpose of the domain is determined according to the status of the first page, the status of the additional pages and results of the processing of the content. The domain profile can be displayed, stored, sent and/or searched to identify web sites or attributes of interest.

Claims

1. A computer-implemented method, comprising:

receiving a first webpage associated with a domain;

determining a plurality of additional webpages associated with the domain based on hyperlinks in the first webpage;

extracting content from the first webpage and the plurality of additional webpages;

determining technical data associated with the first webpage and the plurality of additional webpages;

processing the content and the technical data through a signature marker set to determine a contextual match;

determining a purpose of the domain based on the contextual match;

determining, based on the content, a category associated with the domain, wherein the category is distinct from the purpose and defines a commercial sector of the domain;

generating a domain profile for the domain, wherein the domain profile comprises an indication of the purpose of the domain and an indication of the category associated with the domain;

storing, in a memory, the domain profile;

receiving a query comprising at least one of a purpose and a category;

adding the domain to a list of identified domains based on a determination that the at least one of a purpose and a category corresponds to at least one of the purpose and the category associated with the domain profile; and

outputting the list of identified domains for display in response to the query.

2. The computer-implemented method of claim 1, wherein the technical data comprises one or more of:

average time to render the content;

a geographical location of a webserver associated with at least one of the first webpage or the plurality of additional webpages;

a domain name associated with at least one of the first webpage or the plurality of additional webpages;

a registrar reseller associated with at least one of the first webpage or the plurality of additional webpages;

an absence of a specified data type in at least one of the first webpage or the plurality of additional webpages;

an alternate publisher of at least one of the first webpage or the plurality of additional webpages;

a social community identifier associated with at least one of the first webpage or the plurality of additional webpages;

or

a data type in at least one of the first webpage or the plurality of additional webpages.

3. The computer-implemented method of claim 1, wherein the content comprises one or more of images, video, audio, or executable code.

4. The computer-implemented method of claim 1, further comprising:

determining a status of the first webpage by attempting to load the first webpage; and

determining statuses of the plurality of additional webpages by attempting to load the plurality of additional webpages.

5. The computer-implemented method of claim 4, wherein determining the purpose of the domain further comprises determining the purpose of the domain based on the status of the first webpage and the statuses of the plurality of additional webpages.

6. The computer-implemented method of claim 4, wherein the domain profile further comprises an indication of the status of the first webpage and the statuses of the plurality of additional webpages.

7. The computer-implemented method of claim 1, further comprising:

comparing hyperlinks in the first webpage with predetermined data;

prioritizing the hyperlinks based on the comparing; and

selecting the plurality of additional webpages based on the prioritization.

8. The computer-implemented method of claim 1, wherein the content comprises heading, title, and description content;

wherein processing the content through the signature marker set to determine a contextual match further comprises assigning weights to the heading, title, and description content; and

wherein the contextual match is further determined based on the weights.

9. The computer-implemented method of claim 1, further comprising determining measures of domain traffic associated with the domain, wherein the contextual match is further determined based on the measures.

10. A system, comprising:

a processing system comprising one or more processors; and

a memory system comprising one or more non-transitory computer-readable media, wherein the one or more non-transitory computer-readable media contain instructions that, when executed by the processing system, cause the processing system to perform operations comprising;

receiving a first webpage associated with a domain;

determining a plurality of additional webpages associated with the domain based on hyperlinks in the first webpage;

extracting content from the first webpage and the plurality of additional webpages;

determining technical data associated with the first webpage and the plurality of additional webpages;

processing the content and the technical data through a signature marker set to determine a contextual match;

determining a purpose of the domain based on the contextual match;

determining, based on the content, a category associated with the domain, wherein the category is distinct from the purpose and defines a commercial sector of the domain;

generating a domain profile for the domain, wherein the domain profile comprises an indication of the purpose of the domain and an indication of the category associated with the domain; and

storing, in the one or more non-transitory computer-readable media, the domain profile;

receiving a query comprising at least one of a purpose and a category;

adding the domain to a list of identified domains based on a determination that the at least one of a purpose and a category corresponds to at least one of the purpose and the category associated with the domain profile; and

outputting the list of identified domains for display in response to the query.

11. The system of claim 10, wherein the technical data comprises one or more of:

average time to render the content;

a geographical location of a webserver associated with at least one of the first webpage or the plurality of additional webpages;

a domain name associated with at least one of the first webpage or the plurality of additional webpages;

a registrar reseller associated with at least one of the first webpage or the plurality of additional webpages;

an absence of a specified data type in at least one of the first webpage or the plurality of additional webpages;

an alternate publisher of at least one of the first webpage or the plurality of additional webpages;

a social community identifier associated with at least one of the first webpage or the plurality of additional webpages;

or

a data type in at least one of the first webpage or the plurality of additional webpages.

12. The system of claim 10, wherein the content comprises one or more of images, video, audio, or executable code.

13. The system of claim 10, the operations further comprising:

determining a status of the first webpage by attempting to load the first webpage; and

determining statuses of the plurality of additional webpages by attempting to load the plurality of additional webpages.

14. The system of claim 13, wherein determining the purpose of the domain further comprises determining the purpose of the domain based on the status of the first webpage and the statuses of the plurality of additional webpages.

15. The system of claim 13, wherein the domain profile further comprises an indication of the status of the first webpage and the statuses of the plurality of additional webpages.

16. The system of claim 10, the operations further comprising:

comparing hyperlinks in the first webpage with predetermined data;

prioritizing the hyperlinks based on the comparing; and

selecting the plurality of additional webpages based on the prioritization.

17. The system of claim 10, wherein the content comprises heading, title, and description content;

wherein processing the content through the signature marker set to determine a contextual match further comprises assigning weights to the heading, title, and description content; and

wherein the contextual match is further determined based on the weights.

18. The system of claim 10, the operations further comprising determining measures of domain traffic associated with the domain, wherein the contextual match is further determined based on the measures.