System and method for identifying relationships between database records

• US 20060010144A1
• Filed: 08/01/2005
• Published: 01/12/2006
• Est. Priority Date: 02/20/2002
• Status: Active Grant

• Current Assignee: Syngence Corp.
• Original Assignee: Lawrence Technologies LLC
• Inventors: Loafman, Kenneth W., Benno, Stephen A., Lawrence, P. Nick
• Granted Patent: US 7,246,129 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing

Abstract

A system for identifying relationships between database records includes a memory operable to store a plurality of records comprising a first record and at least one second record. Each record comprises at least one of a plurality of tokens. The system also includes one or more processors collectively operable to determine a weight associated with each of the tokens, compare at least one second record to the first record, and determine at least one relationship indicator based on the comparison and at least one of the weights. The at least one relationship indicator identifies a level of relationship between the first record and at least one second record.

Claims

1-53. -53. (canceled)

54. A system for identifying relationships between database records, comprising:

a memory operable to store a plurality of records, each record comprising at least one of a plurality of tokens; and

one or more processors collectively operable to;

determine a number of times that each token appears in the plurality of records;

determine a number of times that all tokens appear in the plurality of records;

determine a weight associated with each of the tokens, each weight based at least partially on the number of times that one of the tokens appears in the plurality of records and the number of times that all tokens appear in the plurality of records;

generate a token table containing each of the tokens, a token representation associated with each token, and the weight associated with each token;

generate a records table containing one or more token representations associated with the one or more tokens contained in each record, the records table also identifying a number of times that the one or more tokens appear in each record; and

generate a records table index containing a location in the records table associated with each record and a record score associated with each record.

55. The system of claim 54, wherein the weight associated with one of the tokens is determined using a formula of:

56. The system of claim 54, wherein the record score associated with one of the records is determined using a formula of:

57. The system of claim 54, wherein:

each record is associated with at least one document; and

the one or more processors are collectively operable to;

generate a plurality of text files, each text file associated with one of the documents and comprising the tokens contained in the associated document; and

generate the plurality of records, each record associated with one of the text files and comprising the tokens contained in the associated text file.

58. The system of claim 57, wherein the one or more processors are collectively operable to generate one of the records by:

identifying one-word tokens in one of the text files, the one-word tokens comprising individual words in the text file;

inserting the one-word tokens in the record;

selecting pairs of one-word tokens in the record, each pair of one-word tokens comprising consecutive one-word tokens in the record;

combining the pairs of one-word tokens to produce two-word tokens; and

inserting the two-word tokens in the record.

59. The system of claim 54, wherein the token representations comprise correlithm objects, each correlithm object comprising a plurality of values defining a first point in a particular space, the particular space defined by a plurality of dimensions and including a plurality of points.

60. The system of claim 59, wherein:

a distance between the first point and each of the plurality of points in the particular space defines a distribution having a standard deviation; and

a number of values in the correlithm object associated with one of the tokens may be determined using a formula of;

Number of Values=┌

Weight_Token*Standard Deviation┐

where Weight_Token represents the weight associated with the token, and Standard Deviation represents the standard deviation of the distribution.

61. The system of claim 59, wherein each token representation further comprises a significance vector.

62. The system of claim 61, wherein each significance vector comprises a plurality of significance values, each significance value determined using a formula of:

63. The system of claim 59, wherein:

the correlithm objects comprises first correlithm objects, each first correlithm object associated with a first significance vector; and

the one or more processors are further collectively operable to generate a second correlithm object and a second significance vector associated with each record, each second correlithm object comprising at least one of the first correlithm objects.

64. The system of claim 63, wherein:

the second correlithm object comprises one or more first entries and the second significance vector comprises one or more second entries, at least one first entry comprising one of the first correlithm objects; and

a number of first entries in the second correlithm object and a number of second entries in the second significance vector are determined using a formula of;

$\mathrm{Number}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{of}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{Entries}=\underset{i=1}{\overset{j}{\sum <br><br>}}<br><br>\text{\hspace{1em}<br><br>}<br><br>\left(\mathrm{Maximum}<br><br>\text{\hspace{1em}<br><br>}<br><br>{\mathrm{Instances}}_{{\mathrm{Token}}_i}\right)$

where j represents a number of unique tokens contained in the plurality of records, and Maximum Instances_{Token i} represents a maximum number of times that the ith unique token appears in a single record in the plurality of records.

65. The system of claim 64, wherein:

each first entry in the second correlithm object is associated with an instance of one of the tokens;

each first entry in the second correlithm object is also associated with one second entry in the second significance vector; and

the one or more processors are collectively operable to generate the second significance vector by;

determining whether the instance of the token associated with one of the first entries appears in the first record;

inserting one or more non-zero significance values into the second entry associated with the first entry when the instance of the token associated with the first entry appears in the first record; and

inserting one or more zero significance values into the second entry associated with the first entry when the instance of the token associated with the first entry does not appear in the first record.

66. The system of claim 63, wherein:

the second correlithm object comprises a plurality of first entries and the second significance vector comprises a plurality of second entries, at least one first entry comprising one of the first correlithm objects; and

a number of first entries in the second correlithm object and a number of second entries in the second significance vector equal a number of unique tokens in the plurality of records.

67. The system of claim 66, wherein:

each first entry in the second correlithm object is associated with one of the unique tokens;

each first entry in the second correlithm object is also associated with one second entry in the second significance vector; and

the one or more processors are collectively operable to generate the second significance vector by;

determining a number of times that the unique token associated with the first entry appears in the first record;

determining a maximum number of times that the unique token associated with the first entry appears in a single record in the plurality of records;

inserting one or more significance values from the first significance vector associated with the unique token into the second entry associated with the first entry when the unique token associated with the first entry appears the maximum number of times in the first record;

inserting one or more scaled significance values from the first significance vector associated with the unique token into the second entry associated with the first entry when the unique token associated with the first entry appears at least once but less than the maximum number of times in the first record; and

inserting one or more zero significance values into the second entry associated with the first entry when the unique token associated with the first entry does not appear in the first record.

68. The system of claim 54, wherein:

at least one token comprises a first correlithm object; and

at least one of the records comprises a second correlithm object, the second correlithm object comprising at least one of the first correlithm objects.

69. A method for identifying relationships between database records, comprising:

determining a number of times that each of a plurality of tokens appears in a plurality of records, each record comprising at least one of the plurality of tokens;

determining a number of times that all tokens appear in the plurality of records;

determining a weight associated with each of the tokens, each weight based at least partially on the number of times that one of the tokens appears in the plurality of records and the number of times that all tokens appear in the plurality of records;

generating a token table containing each of the tokens, a token representation associated with each token, and the weight associated with each token;

generating a records table containing one or more token representations associated with the one or more tokens contained in each record, the records table also identifying a number of times that the one or more tokens appear in each record; and

generating a records table index containing a location in the records table associated with each record and a record score associated with each record.

70. The method of claim 69, wherein the weight associated with one of the tokens is determined using a formula of:

71. The method of claim 69, wherein the record score associated with one of the records is determined using a formula of:

72. The method of claim 69, wherein each record is associated with at least one document;

and

further comprising;

generating a plurality of text files, each text file associated with one of the documents and comprising the tokens contained in the associated document; and

generating the plurality of records, each record associated with one of the text files and comprising the tokens contained in the associated text file.

73. The method of claim 72, wherein generating one of the records comprises:

identifying one-word tokens in one of the text files, the one-word tokens comprising individual words in the text file;

inserting the one-word tokens in the record;

selecting pairs of one-word tokens in the record, each pair of one-word tokens comprising consecutive one-word tokens in the record;

combining the pairs of one-word tokens to produce two-word tokens; and

inserting the two-word tokens in the record.

74. The method of claim 69, wherein the token representations comprise correlithm objects, each correlithm object comprising a plurality of values defining a first point in a particular space, the particular space defined by a plurality of dimensions and including a plurality of points.

75. The method of claim 74, wherein:

a distance between the first point and each of the plurality of points in the particular space defines a distribution having a standard deviation; and

a number of values in the correlithm object associated with one of the tokens may be determined using a formula of;

Number of Values=┌

Weight_Token*Standard Deviation┐

where Weight_Token represents the weight associated with the token, and Standard Deviation represents the standard deviation of the distribution.

76. The method of claim 74, wherein each token representation further comprises a significance vector.

77. The method of claim 76, wherein each significance vector comprises a plurality of significance values, each significance value determined using a formula of:

78. The method of claim 74, wherein the correlithm objects comprises first correlithm objects, each first correlithm object associated with a first significance vector;

and

further comprising generating a second correlithm object and a second significance vector associated with each record, each second correlithm object comprising at least one of the first correlithm objects.

79. The method of claim 78, wherein:

the second correlithm object comprises one or more first entries and the second significance vector comprises one or more second entries, at least one first entry comprising one of the first correlithm objects; and

a number of first entries in the second correlithm object and a number of second entries in the second significance vector are determined using a formula of;

$\mathrm{Number}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{of}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{Entries}=\underset{i=1}{\overset{j}{\sum <br><br>}}<br><br>\text{\hspace{1em}<br><br>}<br><br>\left(\mathrm{Maximum}<br><br>\text{\hspace{1em}<br><br>}<br><br>{\mathrm{Instances}}_{{\mathrm{Token}}_i}\right)$

where j represents a number of unique tokens contained in the plurality of records, and Maximum Instances_{Token i} represents a maximum number of times that the ith unique token appears in a single record in the plurality of records.

80. The method of claim 79, wherein:

each first entry in the second correlithm object is associated with an instance of one of the tokens;

each first entry in the second correlithm object is also associated with one second entry in the second significance vector; and

generating the second significance vector comprises;

determining whether the instance of the token associated with one of the first entries appears in the first record;

inserting one or more non-zero significance values into the second entry associated with the first entry when the instance of the token associated with the first entry appears in the first record; and

inserting one or more zero significance values into the second entry associated with the first entry when the instance of the token associated with the first entry does not appear in the first record.

81. The method of claim 78, wherein:

the second correlithm object comprises a plurality of first entries and the second significance vector comprises a plurality of second entries, at least one first entry comprising one of the first correlithm objects; and

a number of first entries in the second correlithm object and a number of second entries in the second significance vector equal a number of unique tokens in the plurality of records.

82. The method of claim 81, wherein:

each first entry in the second correlithm object is associated with one of the unique tokens;

each first entry in the second correlithm object is also associated with one second entry in the second significance vector; and

generating the second significance vector comprises;

determining a number of times that the unique token associated with the first entry appears in the first record;

determining a maximum number of times that the unique token associated with the first entry appears in a single record in the plurality of records;

inserting one or more significance values from the first significance vector associated with the unique token into the second entry associated with the first entry when the unique token associated with the first entry appears the maximum number of times in the first record;

inserting one or more scaled significance values from the first significance vector associated with the unique token into the second entry associated with the first entry when the unique token associated with the first entry appears at least once but less than the maximum number of times in the first record; and

inserting one or more zero significance values into the second entry associated with the first entry when the unique token associated with the first entry does not appear in the first record.

83. The method of claim 69, wherein:

at least one token comprises a first correlithm object; and

at least one of the records comprises a second correlithm object, the second correlithm object comprising at least one of the first correlithm objects.

84. Software for identifying relationships between database records, the software embodied on at least one computer readable medium and operable when executed to:

determine a number of times that each of a plurality of tokens appears in a plurality of records, each record comprising at least one of the plurality of tokens;

determine a number of times that all tokens appear in the plurality of records;

determine a weight associated with each of the tokens, each weight based at least partially on the number of times that one of the tokens appears in the plurality of records and the number of times that all tokens appear in the plurality of records;

generate a token table containing each of the tokens, a token representation associated with each token, and the weight associated with each token;

generate a records table containing one or more token representations associated with the one or more tokens contained in each record, the records table also identifying a number of times that the one or more tokens appear in each record; and

generate a records table index containing a location in the records table associated with each record and a record score associated with each record.

85. A system for identifying relationships between database records, comprising:

means for storing a plurality of records, each record comprising at least one of a plurality of tokens;

means for determining a number of times that each token appears in the plurality of records;

means for determining a number of times that all tokens appear in the plurality of records;

means for determining a weight associated with each of the tokens, each weight based at least partially on the number of times that one of the tokens appears in the plurality of records and the number of times that all tokens appear in the plurality of records;

means for generating a token table containing each of the tokens, a token representation associated with each token, and the weight associated with each token;

means for generating a records table containing one or more token representations associated with the one or more tokens contained in each record, the records table also identifying a number of times that the one or more tokens appear in each record; and

means for generating a records table index containing a location in the records table associated with each record and a record score associated with each record.

86-115. -115. (canceled)

86. A system for identifying relationships between database records, comprising:

a memory operable to store;

a token table containing each of a plurality of tokens, a token representation associated with each token, and a weight associated with each token;

a records table containing one or more token representations associated with one or more tokens contained in each of a first record and a second record, the records table also identifying a number of times that the one or more tokens appear in each record; and

a records table index containing a location in the records table associated with each record and a record score associated with each record; and

one or more processors collectively operable to;

identify the one or more token representations associated with the first record and the one or more token representations associated with the second record using the records table index and the records table; and

determine a relationship indicator associated with the second record using the identified token representations, the record score associated with the first record, and at least one of the weights associated with the token representations, the at least one relationship indicator identifying a level of relationship between the first record and at least one second record.

87. The system of claim 86, wherein the weight associated with one of the tokens is determined using a formula of:

88. The system of claim 86, wherein the record score associated with the first record is determined using a formula of:

89. The system of claim 86, wherein the one or more processors are further collectively operable to:

identify any common tokens, a common token comprising one of the tokens that appears in both the first record and the second record; and

identify a common count value for each common token, the common count value representing a minimum number of times that the common token appears in either the first record or the second record.

90. The system of claim 89, wherein the relationship indicator associated with the second record when compared to the first record is determined using a formula of:

91. The system of claim 86, wherein:

a plurality of second records are each associated with at least one document;

the one or more processors are collectively operable to determine a plurality of relationship indicators associated with the plurality of second records; and

the one or more processors are further collectively operable to;

select one or more of the second records based on the relationship indicators; and

make the documents associated with the one or more second records available to a user.

92. The system of claim 86, wherein the one or more processors are collectively operable to allow a user to select the first record, wherein selecting the first record comprises at least one of selecting one of the plurality of records and submitting a document that the one or more processors may use to generate the first record.

93. The system of claim 86, wherein the one or more processors are further collectively operable to:

receive a query from a user;

identify one or more records that satisfy the query;

identify one or more documents associated with the one or more records; and

make the one or more documents available to the user.

94. The system of claim 86, wherein:

a first correlithm object and a first significance vector are associated with each of the tokens, each first correlithm object comprising a plurality of values defining a first point in a particular space, the particular space defined by a plurality of dimensions and including a plurality of points; and

a second correlithm object and a second significance vector are associated with each of the first record and the second record, each second correlithm object comprising at least one of the first correlithm objects.

95. The system of claim 94, wherein:

a distance between one of the first points and each of the plurality of points in one of the particular spaces defines a distribution having a standard deviation; and

a number of values in one of the first correlithm objects associated with one of the tokens may be determined using a formula of;

Number of Values=┌

Weight_Token*Standard Deviation┐

where Weight_Token represents the weight associated with the token, and Standard Deviation represents the standard deviation of the distribution.

96. The system of claim 95, wherein one of the first significance vectors comprises a plurality of significance values, each significance value determined using a formula of:

97. The system of claim 94, wherein:

the second correlithm object comprises one or more first entries and the second significance vector comprises one or more second entries, at least one first entry comprising one of the first correlithm objects; and

each first entry in the second correlithm objects is associated with an instance of one of the tokens.

98. The system of claim 94, wherein:

the second correlithm object comprises one or more first entries and the second significance vector comprises one or more second entries, at least one first entry comprising one of the first correlithm objects; and

each first entry in the second correlithm objects is associated with one of the unique tokens.

99. The system of claim 94, wherein:

the second correlithm object comprises one or more first entries and the second significance vector comprises one or more second entries, at least one first entry comprising one of the first correlithm objects;

each first entry in the second correlithm object is also associated with one second entry in the second significance vector;

the relationship indicator associated with the second record when compared to the first record is determined using a formula of;

$\mathrm{Relationship}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{Indicator}=\frac{\underset{i=1}{\overset{N}{\sum <br><br>}}<br><br>\text{\hspace{1em}<br><br>}<br><br>\left(\begin{array}{c}{\mathrm{Overlap}}_{{\mathrm{AS}}_i,{\mathrm{BS}}_i}*\\ \left(\mathrm{Stnd}.\text{\hspace{1em}<br><br>}<br><br>\mathrm{Dist}<br><br>{.}_i^2<br><br>-\underset{j=1}{\overset{M}{\sum <br><br>}}<br><br>\text{\hspace{1em}<br><br>}<br><br>{\left(A_j-B_j\right)}^2\right)\end{array}\right)}{\underset{i=1}{\overset{N}{\sum <br><br>}}<br><br>\text{\hspace{1em}<br><br>}<br><br>\left({\mathrm{Overlap}}_{{\mathrm{AS}}_{i_i}<br><br>{\mathrm{AS}<br><br>\text{\hspace{1em}<br><br>}}_i}*\mathrm{Stnd}.\text{\hspace{1em}<br><br>}<br><br>\mathrm{Dist}<br><br>{.}_i^2\right)}$

where N represents the number of first entries in the second correlithm objects and the number of second entries in the second significance vectors, AS_i represents significance values in the ith second entry of the second significance vector associated with the first record, BS_i represents significance values in the ith second entry of the second significance vector associated with the second record, Overlap_Asi,Bsi and Overlap_Asi,ASi each represents an overlap value between the identified significance values in the second significance vectors, Stnd. Dist._i represents a standard distance associated with the first correlithm objects contained in the ith first entries of the second correlithm objects, M represents the number of values in the first correlithm objects contained in the ith first entries of the second correlithm objects, A_j represents the jth value of the first correlithm object contained in the ith first entry of the second correlithm object associated with the first record, and B_j represents the jth value of the first correlithm object contained in the ith first entry of the second correlithm object associated with the second record; and

wherein Overlap_ASi,BSi and Overlap_ASi,ASi each comprises one of a minimum of the identified significance values in the second significance vectors and a product of the identified significance values in the second significance vectors.

100. The system of claim 86, wherein:

at least one token comprises a first correlithm object; and

at least one of the records comprises a second correlithm object, the second correlithm object comprising at least one of the first correlithm objects.

101. A method for identifying relationships between database records, comprising:

identifying one or more token representations associated with a first record and one or more token representations associated with a second record using a records table index and a records table, the records table containing the one or more token representations associated with one or more tokens contained in each of the records, the records table also identifying a number of times that the one or more tokens appear in each record, the records table index containing a location in the records table associated with each record and a record score associated with each record; and

determining a relationship indicator associated with the second record using the identified token representations, the record score associated with the first record, and at least one of a plurality of weights associated with the token representations, the at least one relationship indicator identifying a level of relationship between the first record and at least one second record.

102. The method of claim 101, wherein the weight associated with one of the tokens is determined using a formula of:

103. The method of claim 101, wherein the record score associated with the first record is determined using a formula of:

104. The method of claim 101, further comprising:

identifying any common tokens, a common token comprising one of the tokens that appears in both the first record and the second record; and

identifying a common count value for each common token, the common count value representing a minimum number of times that the common token appears in either the first record or the second record.

105. The method of claim 104, wherein the relationship indicator associated with the second record when compared to the first record is determined using a formula of:

106. The method of claim 101, wherein:

a plurality of second records are each associated with at least one document;

a plurality of relationship indicators associated with the plurality of second records are determined; and

further comprising;

selecting one or more of the second records based on the relationship indicators; and

making the documents associated with the one or more second records available to a user.

107. The method of claim 101, wherein:

a first correlithm object and a first significance vector are associated with each of the tokens, each first correlithm object comprising a plurality of values defining a first point in a particular space, the particular space defined by a plurality of dimensions and including a plurality of points; and

a second correlithm object and a second significance vector are associated with each of the first record and the second record, each second correlithm object comprising at least one of the first correlithm objects.

108. The method of claim 107, wherein:

a distance between one of the first points and each of the plurality of points in one of the particular spaces defines a distribution having a standard deviation;

a number of values in one of the first correlithm objects associated with one of the tokens may be determined using a formula of;

Number of Values=┌

Weight_Token*Standard Deviation┐

where Weight_Token represents the weight associated with the token, and Standard Deviation represents the standard deviation of the distribution; and

one of the first significance vectors comprises a plurality of significance values, each significance value determined using a formula of;

$\mathrm{Significance}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{Value}=\frac{{\mathrm{Weight}}_{\mathrm{Token}}*\mathrm{Standard}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{Deviation}}{\mathrm{Number}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{of}<br><br>\text{\hspace{1em}<br><br>}<br><br>\mathrm{Values}}.$

109. The method of claim 107, wherein:

the second correlithm object comprises one or more first entries and the second significance vector comprises one or more second entries, at least one first entry comprising one of the first correlithm objects; and

each first entry in the second correlithm objects is associated with an instance of one of the tokens.

110. The method of claim 107, wherein:

the second correlithm object comprises one or more first entries and the second significance vector comprises one or more second entries, at least one first entry comprising one of the first correlithm objects; and

each first entry in the second correlithm objects is associated with one of the unique tokens.

111. The method of claim 107, wherein:

the second correlithm object comprises one or more first entries and the second significance vector comprises one or more second entries, at least one first entry comprising one of the first correlithm objects;

each first entry in the second correlithm object is also associated with one second entry in the second significance vector;

the relationship indicator associated with the second record when compared to the first record is determined using a formula of;

$\begin{array}{c}\mathrm{Relationship}\\ \mathrm{Indicator}\end{array}=\frac{\underset{i=1}{\overset{N}{\sum <br><br>}}<br><br>\left({\mathrm{Overlap}}_{{\mathrm{AS}}_i,{\mathrm{BS}}_i}*\left(\mathrm{Stnd}.\text{\hspace{1em}<br><br>}<br><br>\mathrm{Dist}<br><br>{.}_i^2<br><br>-\underset{j=1}{\overset{M}{\sum <br><br>}}<br><br>{\left(A_j-B_j\right)}^2\right)\right)}{\underset{i=1}{\overset{N}{\sum <br><br>}}<br><br>\left({\mathrm{Overlap}}_{{\mathrm{AS}}_{i_i}<br><br>{\mathrm{AS}}_i}*\mathrm{Stnd}.\text{\hspace{1em}<br><br>}<br><br>\mathrm{Dist}<br><br>{.}_i^2\right)}$

where N represents the number of first entries in the second correlithm objects and the number of second entries in the second significance vectors, AS_i represents significance values in the ith second entry of the second significance vector associated with the first record, BS_i represents significance values in the ith second entry of the second significance vector associated with the second record, Overlap_ASi,Bsi and Overlap_Asi,ASi each represents an overlap value between the identified significance values in the second significance vectors, Stnd. Dist._i represents a standard distance associated with the first correlithm objects contained in the ith first entries of the second correlithm objects, M represents the number of values in the first correlithm objects contained in the ith first entries of the second correlithm objects, A_j represents the jth value of the first correlithm object contained in the ith first entry of the second correlithm object associated with the first record, and B_j represents the jth value of the first correlithm object contained in the ith first entry of the second correlithm object associated with the second record; and

wherein Overlap_ASi,BSi and Overlap_ASi,ASi each comprises one of a minimum of the identified significance values in the second significance vectors and a product of the identified significance values in the second significance vectors.

112. The method of claim 101, wherein:

at least one token comprises a first correlithm object; and

at least one of the records comprises a second correlithm object, the second correlithm object comprising at least one of the first correlithm objects.

113. Software for identifying relationships between database records, the software embodied on at least one computer readable medium and operable when executed to:

identify one or more token representations associated with a first record and one or more token representations associated with a second record using a records table index and a records table, the records table containing the one or more token representations associated with one or more tokens contained in each of the records, the records table also identifying a number of times that the one or more tokens appear in each record, the records table index containing a location in the records table associated with each record and a record score associated with each record; and

determine a relationship indicator associated with the second record using the identified token representations, the record score associated with the first record, and at least one of a plurality of weights associated with the token representations, the at least one relationship indicator identifying a level of relationship between the first record and at least one second record.

114. A system for identifying relationships between database records, comprising:

means for identifying one or more token representations associated with a first record and one or more token representations associated with a second record using a records table index and a records table, the records table containing the one or more token representations associated with one or more tokens contained in each of the records, the records table also identifying a number of times that the one or more tokens appear in each record, the records table index containing a location in the records table associated with each record and a record score associated with each record; and

means for determining a relationship indicator associated with the second record using the identified token representations, the record score associated with the first record, and at least one of a plurality of weights associated with the token representations, the at least one relationship indicator identifying a level of relationship between the first record and at least one second record.

115. A method for identifying relationships between database records, comprising:

communicating at least one of one or more documents, one or more text files, and one or more records to a server, each of the at least one of the documents, the text files, and the records comprising at least one of a plurality of tokens; and

wherein the server is operable to;

determine a weight associated with each of the tokens;

compare two of the at least one of the documents, the text files and the records; and

determine a relationship indicator based on the comparison and at least one of the weights, the at least one relationship indicator identifying a level of relationship between the two of the at least one of the documents, the text files and the records.

116. A method for identifying relationships between database records, comprising:

communicating at least one of one or more documents, one or more text files, and one or more records to an indexing engine, each of the at least one of the documents, the text files, and the records comprising at least one of a plurality of tokens; and

wherein the indexing engine is operable to;

determine a number of times that each token appears in the at least one of the documents, the text files, and the records;

determine a number of times that all tokens appear in the at least one of the documents, the text files, and the records;

determine a weight associated with each of the tokens, each weight based at least partially on the number of times that one of the tokens appears in the at least one of the documents, the text files, and the records and the number of times that all tokens appear in the at least one of the documents, the text files, and the records;

generate a token table containing each of the tokens, a token representation associated with each token, and the weight associated with each token;

generate a records table containing one or more token representations associated with the one or more tokens contained in each of the at least one of the documents, the text files, and the records, the records table also identifying a number of times that the one or more tokens appear in each of the at least one of the documents, the text files, and the records; and

generate a records table index containing a location in the records table associated with each of the at least one of the documents, the text files, and the records and a score associated with each of the at least one of the documents, the text files, and the records.