Method and system for creating a concept-object database

• US 7,707,161 B2
• Filed: 07/18/2006
• Issued: 04/27/2010
• Est. Priority Date: 07/18/2006
• Status: Active Grant

• Current Assignee: Fiver LLC
• Original Assignee: Vulcan Labs LLC (Vulcan, Inc.)
• Inventors: Allen, Paul G., Jacob, Arun T., Greaves, Mark Thomas, Hall, Stephen G.
• Primary Examiner(s): Cottingham, John R.
• Assistant Examiner(s): Uddin, Mohammed R
• Application Number:
  US11/489,243
• Publication Number:
  US 20080021924A1
• Time in Patent Office: 1,379 Days
• Field of Search: 707/103, 707/3, 707/102
• US Class Current: 1/1
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: Y10S 707/99944 Object-oriented database structure

Abstract

Embodiments of the present invention are directed to acquiring information from the worldwide web, organizing information acquired from the worldwide web, and using the acquired and organized information to facilitate web-page searching, web-page browsing, and other worldwide-web-based activities. In one embodiment of the present invention, a database of concept objects is created from an initial set of semantic objects and from hyperlink information obtained from web pages by one or more web crawlers. The initial set of semantic objects is processed using hyperlink based objects created by the web crawler. The processed semantic objects are then associated with additional hyperlink-based objects to create a concept-object database. In certain embodiments of the present invention, the concept-object database can be further refined and supplemented in an automated fashion by additional web crawling, subsequent association of hyperlink-based objects with concept objects, and creation of new concept objects as well as by user input to, and editing of, the concept-object database. The concept-object database may be employed, in various embodiments of the present invention, to facilitate web browsing, web-page searching, and other worldwide-web-base activities.

Claims

1. A method for creating a concept-object database by an electronic computer, the method comprising:

producing an initial set of semantic objects, each semantic object including a reference to encoded information and an initial list of one or more tags;

binding hyperlinks to semantic objects and processing the hyperlink-bound semantic objects in order to produce a set of first-level concept objects; and

binding additional hyperlinks to first-level concept objects and further processing the additional-hyperlink-bound first-level concept objects to produce a set of concept objects stored in a concept-object database by

searching electronically encoded information, such as web pages within the world-wide web, to identify hyperlinks within the electronically encoded information to identify hyperlinks contained in the electronically encoded information, each identified hyperlink encoded in a hyperlink-based object; and

for each semantic object,

binding, to the semantic object, hyperlinks that reference the encoded information referenced by the semantic object to create a hyperlink context for each semantic object,

determining whether a hyperlink-bound semantic object can be promoted to a first-level concept object, and

when hyperlink-bound semantic object can be promoted to a first-level concept object, processing the hyperlink-bound semantic object to produce a corresponding first-level concept object associated with emergent terms.

2. The method of claim 1 wherein the encoded information includes one or more of:

an HTML file;

an audio file;

a video file;

a file containing encoded graphical information;

an application-specific file;

an executable file; and

a text file.

3. The method of claim 2 wherein producing an initial set of semantic objects further includes one or more of:

extracting semantic objects from a compiled list of annotated links to web pages provided by a commercial web site;

compiling semantic objects from analyzing hyperlink patterns and text and symbols associated with hyperlinks to identify web pages that represent concepts; and

extracting information related to semantic objects from compiled directories, electronic directories, and other compiled and organized data bases, using the extracted information to locate electronic documents that represent web pages and other displayed information, and creating semantic objects corresponding to the electronic documents.

4. The method of claim 1 wherein a tag comprises one or more of:

a word;

a symbol; and

a phrase.

5. The method of claim 1 wherein hyperlinks identified by searching electronically encoded information are processed and filtered by one or more of:

disregarding hyperlinks that encode internal references;

disregarding redundant hyperlink-based objects;

disregarding non-root-domain hyperlink-based objects;

processing anchor text to expand abbreviations;

processing anchor text to correct spelling errors;

processing anchor text to normalize case;

processing anchor text to remove punctuation;

processing anchor text to normalize natural language;

processing anchor text to normalize linguistic derivatives;

processing anchor text to change hyphenated forms to non-hyphenated forms;

processing anchor text to convert grammatical forms; and

processing anchor text to add common synonyms.

6. The method of claim 1 wherein a hyperlink-based object that encodes a hyperlink includes:

a first-reference that references electronically encoded information;

anchor-text that describes the referenced electronically encoded information; and

a second reference that references the encoded information containing the hyperlink.

7. The method of claim 6 wherein binding, to the semantic object, hyperlinks that reference the encoded information referenced by the semantic object to create a hyperlink context for each semantic object further includes binding, to the semantic object, hyperlink-based objects that include first references that reference the encoded information referenced by the semantic object.

8. The method of claim 1 wherein determining whether a hyperlink-bound semantic object can be promoted to a first-level concept object further comprises:

determining a number of hyperlink-based objects bound to the semantic object; and

when the number of hyperlink-based objects bound to the semantic object exceeds a threshold number, determining that the semantic object can be promoted to a first-level concept object.

9. The method of claim 8 wherein determining whether a hyperlink-bound semantic object can be promoted to a first-level concept object further comprises:

determining patterns and distributions of hyperlinks encoded by hyperlink-based objects bound to the semantic object;

determining interrelationships between hyperlink-based objects bound to the semantic object; and

using the determined patterns and distributions of hyperlink encoded by hyperlink-based objects and the determined interrelationships between hyperlink-based objects, in addition to the number of hyperlinks bound to the semantic object, to determine whether a hyperlink-bound semantic object can be promoted to a first-level concept object.

10. The method of claim 1 wherein processing the hyperlink-bound semantic object further comprises:

analyzing anchor text contained in the hyperlink-based objects bound to the semantic object and the tags associated with the semantic object in order to identify a set of emergent terms; and

associating the emergent terms with the identified semantic object.

11. The method of claim 1 wherein binding additional hyperlinks to first-level concept objects and further processing the additional-hyperlink-bound first-level concept objects to produce a set of concept objects stored in a concept-object database further comprises:

binding to the first-level concept objects additional, related hyperlink-based objects;

processing the first-level concept objects with respect to the hyperlink-based objects bound to the first-level concept objects;

determining which of the first-level concept objects to promote to concept objects; and

storing the first-level concept objects determined to be promoted to concept objects in a concept-object database.

12. The method of claim 11 wherein additional, related hyperlink-based objects include one or more of:

hyperlink-based objects with anchor text including terms and phrases that match emergent terms associated with the first-level concept object; and

hyperlink-based objects related to hyperlink-based objects already bound to the first-level concept object.

13. The method of claim 11 wherein processing a first-level concept object with respect to the hyperlink-based objects bound to the first-level concept object further comprises:

refining the emergent terms associated with the first-level concept object; and

accessing electronically encoded information containing the hyperlinks corresponding to the hyperlink-based objects bound to the first-level concept object in order to obtain additional information from the electronically encoded information and to add the additional information to the first-level concept object.

14. The method of claim 11 wherein determining whether a first-level concept object can be promotes to a concept object further comprises:

determining the number of hyperlink-based objects bound to the first-level concept object;

determining patterns and distributions of hyperlinks encoded by hyperlink-based objects bound to the first-level concept object;

determining interrelationships between hyperlink-based objects bound to the first-level concept object; and

determining whether the first-level concept object can be promotes to a concept object based on the determined number of hyperlink-based objects bound to the first-level concept object, the determined patterns and distributions of hyperlinks encoded by hyperlink-based objects bound to the first-level concept object, and the determined interrelationships between hyperlink-based objects bound to the first-level concept object.

15. The method of claim 1 further including subsequently adding new concept objects to the concept-object database, the new concept objects created by one or more of:

user input;

additional searching of electronically encoded information; and

analysis of currently available concept objects, hyperlink-based objects, and electronically encoded information referenced by hyperlink-objects.

16. Computer instructions that implement the method of claim 1 encoded in a computer-readable medium.

17. A concept-object database created by the method of claim 1 that includes stored concept objects encoded in a computer-readable medium.

18. A concept-object-database-creation system comprising:

one or more processors;

a mass-storage subsystem; and

computer instructions that encode the method of claim 1 encoded in a computer-readable medium.