System and method for search engine optimization

• US 10,346,483 B2
• Filed: 10/04/2010
• Issued: 07/09/2019
• Est. Priority Date: 10/02/2009
• Status: Active Grant

• Current Assignee: Akamai Technologies, Inc.
• Original Assignee: Akamai Technologies, Inc.
• Inventors: Drai, David, Trugman, Udi, Zehavi, Ronni
• Primary Examiner(s): Obisesan, Augustine K.
• Application Number:
  US13/499,666
• Publication Number:
  US 20120284252A1
• Time in Patent Office: 3,200 Days
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A method for SEO by optimizing interactions with or through a CDN (content distribution network).

Claims

1. A system for optimizing search engine results using a content distribution network (CDN), the system comprising:

a content distribution network (CDN) comprising a plurality of CDN servers connected to a plurality of content provider servers via the Internet;

wherein the plurality of CDN servers provide website objects from the plurality of content provider servers to web crawlers associated with search engines;

in the plurality of CDN servers, a given CDN server that is programmed to send a site map for a website to a given web crawler associated with a search engine, the site map having been modified by the given CDN server or another CDN server in the plurality of CDN servers after being retrieved from a given content provider server, the modification of the site map improving the given web crawler'"'"'s access to the website, so as to increase the search rank of a first website object within the search engine associated with the given web crawler;

wherein the given CDN server or another CDN server are programmed to modify the site map at least by;

receiving a first request for the first website object from the given web crawler, the first website object being a first page on the website, the first page being HTML coding;

returning the first page to the web crawler, in response to the first request from the given web crawler;

updating the site map, wherein said updating comprises updating the date and time of changes to the first page in the site map;

sending the site map, with said updating, to the given web crawler upon a future visit by the given web crawler;

the given CDN server further being programmed to;

in response to the first request, update stored information that comprises time of access to the website by the given web crawler;

after the update to the time of access, receive a second request for the first website object from the given web crawler, wherein the second request includes an ‘

if-modified-since’

header;

when the CDN server does not know the whether the website object has been modified since the time indicated by the ‘

if-modified-since’

header received from the given web crawler in the second request, the CDN server determining to send the given web crawler a response to the second request indicating that the first page has not changed based on the updated time of access by the given web crawler.

2. The system of claim 1, wherein the given CDN server is programmed to modify the site map, according to a policy communicated to the CDN by the web site owner.

3. The system of claim 1, wherein the site map was created by the given CDN server or another CDN server.

4. A method, for optimizing search engine results using a content distribution network (CDN), the method comprising:

providing a content distribution network (CDN) comprising a plurality of CDN servers connected to a plurality of content provider servers via the Internet;

with the plurality of CDN servers, providing website objects from the plurality of content provider servers to web crawlers associated with search engines;

in the plurality of CDN servers, a given CDN server sending a site map for a web site to a given web crawler associated with a search engine, the site map having been modified by the given CDN server or another CDN server in the plurality of CDN servers after being retrieved from a given content provider server, the modification of the site map improving the given web crawler'"'"'s access to the web site, so as to increase the search rank of a first web site object within the search engine associated with the given web crawler;

wherein said modification by the given CDN server or another CDN server comprises;

receiving a first requests for a first website object from the given web crawler, the first website object being a first page on the web site, the first page being HTML coding;

returning the first page to the given web crawler, in response to the first request from the given web crawler;

updating the site map, wherein said updating comprises indicating updating the date and time of changes to the first page in the site map;

sending the site map, with said updating, to the given web crawler upon a future visit by the given web crawler;

the given CDN server, in response to the first request, updating stored information that comprises time of access to the web site by the given web crawler;

after the update to the time of access, receiving a second request for the first web site object from the given web crawler, wherein the second request includes an ‘

if-modified-since’

header;

when the CDN server does not know the whether the website object has been modified since the time indicated by ‘

if-modified-since’

header receive from the given web crawler in the second request, the CDN server determining to send the given web crawler a response to the second request indicating that the first page has not changed based on the updated time of access by the given web crawler.