HTTP header intermediary for enabling session-based dynamic site searches

• US 20070136477A1
• Filed: 12/12/2005
• Published: 06/14/2007
• Est. Priority Date: 12/12/2005
• Status: Active Grant

• Current Assignee: Answer Financial Incorporated (Allstate Corporation)
• Original Assignee: Answer Financial Incorporated (Allstate Corporation)
• Inventors: Bryce, Daniel, Williams, Todd
• Granted Patent: US 8,380,855 B2
• Time in Patent Office: Days
• US Class Current: 709/227
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/56 Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54

Abstract

In a computer network environment, a content-based session request issued by a search engine agent is modified to enable the search engine to index information from a server to maintain a state connection where the search engine agent cannot maintain session identification. The content-based session request is modified by a header intermediary module which then directs the request to target servers. The response from the web server is again modified by the header intermediary module prior to being sent to the client that issued the request. It is emphasized that this abstract is provided to comply with the rules requiring an abstract which will allow a searcher or other reader to quickly ascertain the subject matter of the technical disclosure. It is submitted with the understanding that it will not be used to interpret or limit the scope or the meaning of the claims.

Claims

1. A method of enabling a client to collect information from a server in a network environment comprising:

receiving a content-based session request submitted by a client;

injecting a proxy session identification into the content-based session request to enable access to a server, wherein the client does not include a session identification in the content-based session request and the session identification is needed to collect information from the server;

removing the proxy session identification from the server'"'"'s response to the client, wherein the proxy session identification is not needed to maintain a state connection between the client and the server after the server'"'"'s response is provided to the client; and

storing the proxy session identification for injection into the content-based session request in a subsequent content-based session request from the client.

2. The method of claim 1, wherein the injecting a proxy session identification into the content-based session request includes attaching a cookie to the content-based session request.

3. The method of claim 1, wherein the injecting a proxy session identification into the content-based session request includes attaching a URL to the content-based session request.

4. The method of claim 1, wherein the injecting a proxy session identification into the content-based session request includes attaching the proxy session identification in an HTTP form field in the content-based session request.

5. The method of claim 1, further comprising determining whether the client is a search engine.

6. The method of claim 1, further comprising determining whether the client is a browser.

7. The method of claim 5, further comprising parsing the content-based session request to determine a type of client, wherein the content-based session request includes a unique identifier comprised of the first access request and at least one header, the unique identifier conveying information identifying the type of client.

8. The method of claim 7, wherein the parsing the content-based session request includes comparing the unique identifier to a stored table of unique identifiers and using pre-defined rules to direct the content-based session request for processing with injection of a specific proxy session identification.

9. The method of claim 8, wherein the stored table of unique identifiers includes a lookup table of known clients.

10. The method of claim 9, wherein the parsing the content-based session request includes blocking unwanted clients identified by the unique identifier.

11. The method of claim 1, further comprising decoding the content-based session request to authenticate the client.

12. The method of claim 1, wherein the proxy session identification does not expire.

13. The method of claim 1, wherein the network is the Internet.

14. The method of claim 1, further comprising injecting a specific proxy session identification where the client is a browser, wherein the browser is not enabled to handle cookies.

28. The system of claim 1, wherein the proxy server injects a specific proxy session identification where the client is a browser that is not enabled to handle cookies.

15. A system for enabling a client to index information over a network comprising:

a proxy server capable of receiving a content-based session request communicated by a client, the content-based session request representing a first access request to at least one content server, wherein the client does not include a session identification in the content-based session request and the session identification is needed to index information from the at least one content server;

a header intermediary module stored on the proxy server, the header intermediary module operable to;

inject a proxy session identification into the content-based session request to enable access to the at least one content server,

remove the proxy session identification from the at least one server'"'"'s response to the first access request, wherein the proxy session identification is not needed to maintain a state connection between the client and the at least one content server after the at least one content server'"'"'s response to the client, and

store the proxy session identification for injection into the content-based session request in a subsequent access request from the client.

16. The system of claim 15, wherein the proxy session identification is injected into the content-based session request as a cookie.

17. The system of claim 15, wherein the proxy session identification is injected into the content-based session request as a URL.

18. The system of claim 15, wherein the proxy session identification is injected into the content-based session request as an HTTP form field.

19. The system of claim 15, wherein the client is a search engine.

20. The system of claim 15, wherein the client is a browser.

21. The system of claim 20, wherein the proxy server determines a type of client, the content-based session request including a unique identifier comprised of the first access request and at least one header, the unique identifier conveying information identifying the type of client.

22. The system of claim 21, wherein the unique identifier is compared to a stored table of unique identifiers, the proxy server using pre-defined rules to direct the content-based session request for processing with injection of a specific proxy session identification.

23. The system of claim 22, wherein the stored table of unique identifiers includes a lookup table of known clients.

24. The system of claim 23, wherein the proxy server blocks unwanted clients identified by the unique identifier.

25. The system of claim 15, wherein the proxy server decodes the content-based session request to authenticate the client.

26. The system of claim 15, wherein the proxy session identification does not expire.

27. The system of claim 15, wherein the network is the Internet.

29. The system of claim 15, wherein the client issues a plurality of access requests for content from a plurality of content servers.

30. The system of claim 15, further comprising a load balancing device governing access to a particular server in the plurality of content servers, the load balancing device directing the plurality of access requests to particular content servers in the plurality of content servers.

31. A method of enabling session-based content searching over a network comprising:

receiving a content-based session request from a search engine agent;

injecting a proxy session identification into the content-based session request, wherein the search engine agent does not provide session identification information that is needed to complete the content-based session request;

transmitting the content-based session request to at least one content server controlling access to at least one network location that provides content sought by the search engine agent;

receiving a response from the at least one content server, wherein the response includes the proxy session identification injected into the content-based session request;

removing the proxy session identification from the response;

storing the proxy session identification for injection into a subsequent content-based session request issued by the search engine agent; and

transmitting the response to the search engine agent, wherein the proxy session identification is not needed to maintain a state connection between the at least one content server and the search engine agent after the at least one content server'"'"'s response is transmitted to the search engine agent.

32. The method of claim 31, further comprising parsing the content-based session request to determine a type of search engine, wherein the content-based session request includes a unique identifier comprised of the first access request and at least one header, the unique identifier conveying information identifying the type of search engine.

33. The method of claim 32, further comprising comparing the unique identifier to a stored table of unique identifiers and using pre-defined rules to direct the content-based session request for processing with injection of a specific proxy session identification.

34. The method of claim 33, further comprising blocking unwanted clients identified by the unique identifier.

35. The method of claim 31, further comprising decoding the content-based session request to authenticate the client.

36. The method of claim 31, wherein the receiving a content-based session request from a search engine includes receiving a plurality of content-based session requests, the plurality of content-based session requests seeking content from a plurality of content servers.

37. The system of claim 36, further comprising directing the plurality of content-based session requests to particular content servers in the plurality of content servers, wherein the proxy server includes a load balancing device governing access to a particular server in the plurality of content servers.

38. An article of manufacture comprising a computer program carrier readable by a computer and embodying one or more instructions executable by the computer to enable session-based content searching over a network, comprising:

injecting a proxy session identification into a content-based session request received from a search engine agent, wherein the search engine agent does not provide session identification information that is needed to complete the content-based session request;

processing transmission of the content-based session request to at least one content server controlling access to at least one network location that provides content sought by the search engine agent and receipt of a response from the at least one content server that includes the proxy session identification injected into the content-based session request; and

removing the proxy session identification from the response prior to communication to the search engine agent, wherein the proxy session identification is not needed to maintain a state connection between the at least one content server and the search engine agent.