SYSTEM AND METHOD FOR RETRIEVING INFORMATION FROM THE INTERNET BY MEANS OF AN INTELLIGENT SEARCH AGENT

• US 20090248686A1
• Filed: 03/27/2008
• Published: 10/01/2009
• Est. Priority Date: 03/27/2008
• Status: Active Grant

• Current Assignee: LinkedIn Corporation (Microsoft Corporation)
• Original Assignee: International Business Machines Corporation
• Inventors: Subramanya, Pramod Kumar, Ramanathan, Sri, Ponnappan, Appan, Venkatraman, Balaji
• Granted Patent: US 7,840,582 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/00 Information retrieval; Database structures therefor; File system structures therefor

Abstract

A system and associated method for retrieving information from the Internet by an end user through use of an Intelligent Search Agent. Creating an index comprising a least one data structure corresponding to a respective forum. Next, submitting a query to at least one search engine located on a respective Internet server. After submitting the query, posting a question to at least one forum located on a respective Internet server. After posting the question, subscribing to at least one web syndication corresponding to at least one respective forum. After subscribing to at least one web syndication, receiving information from at least one web syndication. Finally, sending the information to said end user.

Claims

1. A method for retrieving information from the Internet by an end user through use of an Intelligent Search Agent, said method comprising:

creating an index, said index comprising at least one data structure, each data structure of said at least one data structure corresponding to a respective forum located on a respective Internet server, wherein said creating is performed by said Intelligent Search Agent;

after said creating said index, submitting a query to at least one search engine, wherein each search engine of said at least one search engine is located on a respective Internet server, wherein said submitting is performed by said Intelligent Search Agent after receiving said query from said end user;

after said submitting said query, posting a question to at least one forum, wherein each forum of said at least one forum corresponds to a respective data structure located in said index, wherein said posting is performed by said Intelligent Search Agent after receiving said question from said end user;

after said posting said question, subscribing to at least one web syndication, each web syndication of said at least one web syndication corresponds to a respective forum which said question was posted, wherein said subscribing is performed by said Intelligent Search Agent;

after said subscribing, receiving said information from said at least one web syndication, wherein said information is at least one answer to said question, wherein said receiving is performed by said Intelligent Search Agent; and

after said receiving said information, sending said information to said end user, wherein said sending is performed by said Intelligent Search Agent.

2. The method of claim 1, wherein each data structure of said at least one data structure is a tree data structure comprising:

a root node, at least one child node, and at least one leaf node, wherein said root node, said at least one child node, and said at least one leaf node are liked in a hierarchy, wherein said root node comprises a name corresponding to a topic of said respective forum, wherein each child node of said at least one child node comprises a name corresponding to a subtopic of said topic of said respective forum, and a Uniform Resource Identifier (URI) corresponding to an Internet address where said subtopic is located, wherein each leaf node of said at least one leaf node comprises a name corresponding to a conversation of a subtopic of said topic of said respective forum and a URI corresponding to an Internet address where said conversation is located.

3. The method of claim 1, said creating said index further comprising:

storing said index in a database.

4. The method of claim 1, said submitting said query further comprises:

receiving at least one result, wherein each result of said at least one result corresponds to said respective search engine wherein said query was submitted; and

after said receiving said at least one result, sending said at least one result to said end user.

5. The method of claim 1, said posting said question comprising:

parsing said query into at least one keyword, wherein each keyword of said at least one keyword corresponds to a respective portion of said query;

after said parsing said query, searching said index for each keyword of said at least one keyword, wherein said searching comprises;

identifying at least one matching node, wherein each matching node of said at least one matching node corresponds to a keyword of said at least one keyword;

after said searching said index, creating a first list, wherein said first list comprises said name of each matching node of said at least one matching node and said URI of each matching node of said at least one matching node;

after said creating said first list, sending said first list to said end user;

after said sending said first list, receiving a second list from said end user, wherein said second list comprises a subset of said first list which selected by said end user;

after said receiving said second list, storing said second list in said database;

receiving said question from said end user, wherein said question is a natural language translation of said query; and

after said receiving said second list and after said receiving said question, posting said question to each URI of each matching node of said at least one matching node contained in said second list.

6. The method of claim 1, said subscribing comprising:

retrieving each URI of each matching node of said at least one matching node contained in said second list;

after said retrieving, determining whether each URI of each matching node of said at least one matching node contains a respective web syndication;

after said determining, for each URI of each matching node of said at least one matching node containing said respective web syndication, subscribing to said respective web syndication; and

after said determining, for each URI of each matching node of said at least one matching node not containing said respective web syndication, creating a respective web syndication, wherein said creating said respective web syndication comprises;

scraping web content located at each URI of at least one URI not containing said respective web syndication into a respective feed document;

storing said respective feed document in said database; and

subscribing to said respective feed document.

7. A computer program product, comprising a computer usable medium having a computer readable program code embodied therein, said computer readable program code containing instructions that when executed by a processor of a computer system implement a method for retrieving information from the Internet by an end user through use of an Intelligent Search Agent, said method comprising:

creating an index, said index comprising at least one data structure, each data structure of said at least one data structure corresponding to a respective forum located on a respective Internet server, wherein said creating is performed by said Intelligent Search Agent;

after said creating said index, submitting a query to at least one search engine, wherein each search engine of said at least one search engine is located on a respective Internet server, wherein said submitting is performed by said Intelligent Search Agent after receiving said query from said end user;

after said submitting said query, posting a question to at least one forum, wherein each forum of said at least one forum corresponds to a respective data structure located in said index, wherein said posting is performed by said Intelligent Search Agent after receiving said question from said end user;

after said posting said question, subscribing to at least one web syndication, each web syndication of said at least one web syndication corresponds to a respective forum which said question was posted, wherein said subscribing is performed by said Intelligent Search Agent;

after said subscribing, receiving said information from said at least one web syndication, wherein said information is at least one answer to said question, wherein said receiving is performed by said Intelligent Search Agent; and

after said receiving said information, sending said information to said end user, wherein said sending is performed by said Intelligent Search Agent.

8. The computer program product of claim 7, wherein each data structure of said at least one data structure is a tree data structure comprising:

a root node, at least one child node, and at least one leaf node, wherein said root node, said at least one child node, and said at least one leaf node are liked in a hierarchy, wherein said root node comprises a name corresponding to a topic of said respective forum, wherein each child node of said at least one child node comprises a name corresponding to a subtopic of said topic of said respective forum, and a Uniform Resource Identifier (URI) corresponding to an Internet address where said subtopic is located, wherein each leaf node of said at least one leaf node comprises a name corresponding to a conversation of a subtopic of said topic of said respective forum and a URI corresponding to an Internet address where said conversation is located.

9. The computer program product of claim 7, said creating said index further comprising:

storing said index in a database.

10. The computer program product of claim 7, said submitting said query further comprises:

receiving at least one result, wherein each result of said at least one result corresponds to said respective search engine wherein said query was submitted; and

after said receiving said at least one result, sending said at least one result to said end user.

11. The computer program product of claim 7, said posting said question comprising:

parsing said query into at least one keyword, wherein each keyword of said at least one keyword corresponds to a respective portion of said query;

after said parsing said query, searching said index for each keyword of said at least one keyword, wherein said searching comprises;

identifying at least one matching node, wherein each matching node of said at least one matching node corresponds to a keyword of said at least one keyword;

after said searching said index, creating a first list, wherein said first list comprises said name of each matching node of said at least one matching node and said URI of each matching node of said at least one matching node;

after said creating said first list, sending said first list to said end user;

after said sending said first list, receiving a second list from said end user, wherein said second list comprises a subset of said first list which selected by said end user;

after said receiving said second list, storing said second list in said database;

receiving said question from said end user, wherein said question is a natural language translation of said query; and

after said receiving said second list and after said receiving said question, posting said question to each URI of each matching node of said at least one matching node contained in said second list.

12. The computer program product of claim 7, said subscribing comprising:

retrieving each URI of each matching node of said at least one matching node contained in said second list;

after said retrieving, determining whether each URI of each matching node of said at least one matching node contains a respective web syndication;

after said determining, for each URI of each matching node of said at least one matching node containing said respective web syndication, subscribing to said respective web syndication; and

after said determining, for each URI of each matching node of said at least one matching node not containing said respective web syndication, creating a respective web syndication, wherein said creating said respective web syndication comprises;

scraping web content located at each URI of at least one URI not containing said respective web syndication into a respective feed document;

storing said respective feed document in said database; and

subscribing to said respective feed document.

13. A computer system comprising a processor and a computer readable memory unit coupled to the processor, said memory unit containing instructions that when executed by the processor implement a method for retrieving information from the Internet by an end user through use of an Intelligent Search Agent, said method comprising:

creating an index, said index comprising at least one data structure, each data structure of said at least one data structure corresponding to a respective forum located on a respective Internet server, wherein said creating is performed by said Intelligent Search Agent;

after said creating said index, submitting a query to at least one search engine, wherein each search engine of said at least one search engine is located on a respective Internet server, wherein said submitting is performed by said Intelligent Search Agent after receiving said query from said end user;

after said submitting said query, posting a question to at least one forum, wherein each forum of said at least one forum corresponds to a respective data structure located in said index, wherein said posting is performed by said Intelligent Search Agent after receiving said question from said end user;

after said posting said question, subscribing to at least one web syndication, each web syndication of said at least one web syndication corresponds to a respective forum which said question was posted, wherein said subscribing is performed by said Intelligent Search Agent;

after said subscribing, receiving said information from said at least one web syndication, wherein said information is at least one answer to said question, wherein said receiving is performed by said Intelligent Search Agent; and

after said receiving said information, sending said information to said end user, wherein said sending is performed by said Intelligent Search Agent.

14. The computer system of claim 13, wherein each data structure of said at least one data structure is a tree data structure comprising:

a root node, at least one child node, and at least one leaf node, wherein said root node, said at least one child node, and said at least one leaf node are liked in a hierarchy, wherein said root node comprises a name corresponding to a topic of said respective forum, wherein each child node of said at least one child node comprises a name corresponding to a subtopic of said topic of said respective forum, and a Uniform Resource Identifier (URI) corresponding to an Internet address where said subtopic is located, wherein each leaf node of said at least one leaf node comprises a name corresponding to a conversation of a subtopic of said topic of said respective forum and a URI corresponding to an Internet address where said conversation is located.

15. The computer system of claim 13, said creating said index further comprising:

storing said index in a database.

16. The computer system of claim 13, said submitting said query further comprises:

receiving at least one result, wherein each result of said at least one result corresponds to said respective search engine wherein said query was submitted; and

after said receiving said at least one result, sending said at least one result to said end user.

17. The computer system of claim 13, said posting said question comprising:

parsing said query into at least one keyword, wherein each keyword of said at least one keyword corresponds to a respective portion of said query;

after said parsing said query, searching said index for each keyword of said at least one keyword, wherein said searching comprises;

identifying at least one matching node, wherein each matching node of said at least one matching node corresponds to a keyword of said at least one keyword;

after said searching said index, creating a first list, wherein said first list comprises said name of each matching node of said at least one matching node and said URI of each matching node of said at least one matching node;

after said creating said first list, sending said first list to said end user;

after said sending said first list, receiving a second list from said end user, wherein said second list comprises a subset of said first list which selected by said end user;

after said receiving said second list, storing said second list in said database;

receiving said question from said end user, wherein said question is a natural language translation of said query; and

after said receiving said second list and after said receiving said question, posting said question to each URI of each matching node of said at least one matching node contained in said second list.

18. The computer system of claim 13, said subscribing comprising:

retrieving each URI of each matching node of said at least one matching node contained in said second list;

after said retrieving, determining whether each URI of each matching node of said at least one matching node contains a respective web syndication;

after said determining, for each URI of each matching node of said at least one matching node containing said respective web syndication, subscribing to said respective web syndication; and

after said determining, for each URI of each matching node of said at least one matching node not containing said respective web syndication, creating a respective web syndication, wherein said creating said respective web syndication comprises;

scraping web content located at each URI of at least one URI not containing said respective web syndication into a respective feed document;

storing said respective feed document in said database; and

subscribing to said respective feed document.

19. A process for supporting computer infrastructure, said process comprising providing at least one support service for at least one of creating, integrating, hosting, maintaining, and deploying computer-readable code in a computing system, wherein the code in combination with the computing system is capable of performing a method for retrieving information from the Internet by an end user through use of an Intelligent Search Agent, said method comprising:

creating an index, said index comprising at least one data structure, each data structure of said at least one data structure corresponding to a respective forum located on a respective Internet server, wherein said creating is performed by said Intelligent Search Agent;

after said creating said index, submitting a query to at least one search engine, wherein each search engine of said at least one search engine is located on a respective Internet server, wherein said submitting is performed by said Intelligent Search Agent after receiving said query from said end user;

after said submitting said query, posting a question to at least one forum, wherein each forum of said at least one forum corresponds to a respective data structure located in said index, wherein said posting is performed by said Intelligent Search Agent after receiving said question from said end user;

after said posting said question, subscribing to at least one web syndication, each web syndication of said at least one web syndication corresponds to a respective forum which said question was posted, wherein said subscribing is performed by said Intelligent Search Agent;

after said subscribing, receiving said information from said at least one web syndication, wherein said information is at least one answer to said question, wherein said receiving is performed by said Intelligent Search Agent; and

after said receiving said information, sending said information to said end user, wherein said sending is performed by said Intelligent Search Agent.

20. The process of claim 19, wherein each data structure of said at least one data structure is a tree data structure comprising:

a root node, at least one child node, and at least one leaf node, wherein said root node, said at least one child node, and said at least one leaf node are liked in a hierarchy, wherein said root node comprises a name corresponding to a topic of said respective forum, wherein each child node of said at least one child node comprises a name corresponding to a subtopic of said topic of said respective forum, and a Uniform Resource Identifier (URI) corresponding to an Internet address where said subtopic is located, wherein each leaf node of said at least one leaf node comprises a name corresponding to a conversation of a subtopic of said topic of said respective forum and a URI corresponding to an Internet address where said conversation is located.

21. The process of claim 19, said creating said index further comprising:

storing said index in a database.

22. The process of claim 19, said submitting said query further comprises:

receiving at least one result, wherein each result of said at least one result corresponds to said respective search engine wherein said query was submitted; and

after said receiving said at least one result, sending said at least one result to said end user.

23. The process of claim 19, said posting said question comprising:

parsing said query into at least one keyword, wherein each keyword of said at least one keyword corresponds to a respective portion of said query;

after said parsing said query, searching said index for each keyword of said at least one keyword, wherein said searching comprises;

identifying at least one matching node, wherein each matching node of said at least one matching node corresponds to a keyword of said at least one keyword;

after said searching said index, creating a first list, wherein said first list comprises said name of each matching node of said at least one matching node and said URI of each matching node of said at least one matching node;

after said creating said first list, sending said first list to said end user;

after said sending said first list, receiving a second list from said end user, wherein said second list comprises a subset of said first list which selected by said end user;

after said receiving said second list, storing said second list in said database;

receiving said question from said end user, wherein said question is a natural language translation of said query; and

after said receiving said second list and after said receiving said question, posting said question to each URI of each matching node of said at least one matching node contained in said second list.

24. The process of claim 19, said subscribing comprising:

retrieving each URI of each matching node of said at least one matching node contained in said second list;

after said retrieving, determining whether each URI of each matching node of said at least one matching node contains a respective web syndication;

after said determining, for each URI of each matching node of said at least one matching node containing said respective web syndication, subscribing to said respective web syndication; and

after said determining, for each URI of each matching node of said at least one matching node not containing said respective web syndication, creating a respective web syndication, wherein said creating said respective web syndication comprises;

scraping web content located at each URI of at least one URI not containing said respective web syndication into a respective feed document;

storing said respective feed document in said database; and

subscribing to said respective feed document.