Database system and method for data acquisition and perusal

• US 20050027702A1
• Filed: 07/08/2004
• Published: 02/03/2005
• Est. Priority Date: 02/25/1999
• Status: Active Grant

• Current Assignee: Indacon Incorporated
• Original Assignee: Indacon Incorporated
• Inventors: Jensen, Robert Leland, Smith, Daniel Victor
• Granted Patent: US 7,836,043 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/9558 Details of hyperlinks; Management of linked annotations
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: Y10S 707/99932 Access augmentation or optimizing
• CPC Class Codes: Y10S 707/99936 Pattern matching access
• CPC Class Codes: Y10S 707/99943 Generating database or data structure, e.g. via user interface

Abstract

A data acquisition and perusal system and method including a database selection module, a database index generator module and a search module. The database selection module enables selection of a plurality of files for inclusion into at least one selectable database. The database index generator module enables generation of a searchable index of the data contained in the selectable database. The search module enables a search to be performed of the searchable index according to search criteria. The data acquisition and perusal system and method may also allow users to view, acquire, and generate single- or multiple-data sources locally or remotely, and allow users to compile, index, modify, and append the data sources according to default or user defined criteria. The data acquisition and perusal system and method may also selectively acquire and display data contained within remote databases depending upon the user'"'"'s access permissions to such databases. Such a system allows for the capture of HTML data which is automatically indexed without human intervention and has the ability to automatically and accurately locate or “pinpoint,” and highlight specific text or groups of text designated by the user within the resulting database. Such a system contains a link module that enables custom links to be defined between selected terms of selected files of the selectable database including the custom links so that the searchable index includes only valid links.

Claims

1. A data acquisition and perusal system, comprising:

a database selection module that enables selection of a plurality of files including HTML files for inclusion into at least one selectable database;

a link module that enables custom links to be defined between selected terms of selected files of the at least one database;

a database index generator module that enables generation of a searchable index of the data contained in the at least one selectable databases including the custom links, the generator module enabling only valid custom links to be added to the searchable index;

wherein the searchable index stores the word locations of words in the database including word locations of words in the HTML files that can be used to identify and highlight words in HTML files when those files are displayed in HTML format; and

a search module that enables a search of the searchable index to be performed according to a search criterion.

2. The data acquisition and perusal system of claim 1 wherein the plurality of files includes a plurality of different file types.

4. The data acquisition and perusal system of claim 2, further comprising:

a plurality of selectable databases, each capable of including at least one file of a particular type.

5. The data acquisition and perusal system of claim 1 wherein the link module enables association of any link term with any of the plurality of files in the at least one selectable database.

7. The data acquisition and perusal system of claim 1, further comprising:

each of the plurality of files including at least one field; and

the link module enabling field links to be defined between the plurality of files.

10. The data acquisition and perusal system of claim 1 wherein the database selection module enables selection of the plurality of files both locally and remotely via a network.

11. The data acquisition and perusal system of claim 1 wherein the search module enables sorting of any files of the at least one selectable database that meet the search criterion.

12. The data acquisition and perusal system of claim 11, further comprising:

each of the plurality of files including a plurality of fields; and

the search module sorting the any files that meet the search criterion according to the plurality of fields.

13. The data acquisition and perusal system of claim 1, further comprising:

at least one input device; and

a display utility including a graphic user interface that enables graphic interaction with the database selection, the link and the search modules via the at least one input device.

14. The data acquisition and perusal system of claim 13 wherein the display utility displays at least portions of files in the selectable database that meet the search criterion.

15. The data acquisition and perusal system of claim 14 wherein the display utility indicates terms in the displayed file portions that meet the search criterion.

16. The data acquisition and perusal system of claim 14, further comprising:

the link module enabling association of at least one selected link term with any of the plurality of files in the at least one selectable database; and

the display utility indicating any of the at least one selected link term in the displayed portions of files in the selectable database that meet the search criterion.

17. The data acquisition and perusal system of claim 16 wherein the display utility enables interaction with any indicated selected link terms via the at least one input device to enable perusal of linked files in the at least one selectable database.

19. The system of claim 1 wherein the search module further comprises leading conflation logic that operates according to negative searching principles.

3. (cancelled).

6. (canceled).

8-9. -9. (cancelled).

18. (cancelled).

20-51. -51. (cancelled).

52. A data acquisition and perusal method for finding, storing and retrieving useful information, comprising the steps of:

locating a plurality of accessible HTML files according to a selected search criteria;

selecting a plurality of the located files containing relevant information for automatic inclusion into at least one selectable database;

defining custom linking relationships between selected terms and designated files of the selected database;

verifying the validity of the custom linking relationships;

generating a searchable index of the data contained in the selected database including the custom linking relationships so that the searchable index includes only valid custom linking relationships;

searching the searchable index according to a selected search criterion to locate words and phrases in the data; and

accurately highlighting the located terms and phrases while displaying at least portions of the HTML files in accordance with formatting control tags of the HTML files.

56. The data acquisition and perusal method of claim 52 wherein said link definition step is operable to associate any link term with any of the plurality of files in the at least one selectable database.

58. The data acquisition and perusal method of claim 52, further comprising the steps of:

locating a plurality of accessible files including at least one field; and

enabling field links to be defined between the plurality of files.

61. The data acquisition and perusal method of claim 52 wherein said file selection step includes selecting the plurality of files locally and remotely via a network.

62. The data acquisition and perusal method of claim 52 wherein said searching step includes sorting of any files of the selectable database that meet the search criterion.

63. The data acquisition and perusal method of claim 62, further comprising the step of:

file selection including selecting a plurality of files including a plurality of fields; and

said searching step sorting any files that meet the search criterion according to the plurality of fields.

64. The data acquisition and perusal method of claim 52, further comprising the step of:

displaying a graphic user interface that enables graphic interaction with the database selection, the link and the search means via the at least one input device.

67. The data acquisition and perusal method of claim 52, further comprising the step of:

indicating any of the selected linking relationship terms in the displayed portions of files in the selectable database.

68. The data acquisition and perusal method of claim 67 wherein the step of displaying includes enabling interaction with any indicated selected linking relationship terms via at least one input device to enable perusal of linked files in the at least one selectable database.

72. The data acquisition and perusal method of claim 52 including the steps of:

viewing and acquiring single and multiple data sources locally or remotely, and compiling, indexing, modifying, appending, and linking the data sources locally and remotely according to default and user defined criteria.

73. The data acquisition and perusal method of claim 52 including the step of:

selectively acquiring and displaying data contained within remote databases depending upon the user'"'"'s access permissions to such databases.

53-55. -55. (cancelled).

57. (cancelled).

59-60. -60. (cancelled).

65-66. -66. (cancelled).

69-71. -71. (cancelled).

74. A data acquisition and perusal method, comprising the steps of:

selecting a plurality of files, including HTML type format, for inclusion into at least one selectable database;

generating a searchable index of the plurality of selected files included in the selectable database;

wherein the searchable index stores the word locations of words in the database, including word locations of words in the HTML files that can be used to identify and highlight words in HTML files when those files are displayed in HTML format; and

searching the searchable index according to search criteria;

said data selection, database index generator and search steps allowing users to view and acquire single or multiple data sources locally and remotely, and allowing users to compile, index, modify, and append the data sources locally and remotely according to default or user defined criteria.

75. The data acquisition and perusal method of claim 74, comprising the step of:

acquiring and displaying data contained within remote databases depending upon the user'"'"'s access permissions to such databases.

77. The data acquisition and perusal method of claim 74, comprising the step of:

creating custom links to be defined between selected terms of selected files of the selectable database including the custom links so that the searchable index includes only valid links.

76. (cancelled).

78. A data indexing and perusal system comprising:

an index module that enables generation of a searchable index of a plurality of selected source files, including HTML files;

wherein the searchable index stores word locations of words in the source files, including the word locations of words in HTML files that can be used to identify and highlight words in HTML files while those files are displayed in HTML format;

a search module that enables a search to be performed of the index according to a search criterion to locate words and phrases in the plurality of selected source files;

a display utility that displays at least portions of files in the plurality of selected source files that meet the search criterion; and

an annotation module that enables users to generate annotations of the plurality of selected source files, the annotations being displayable by the display utility.

79. The data indexing and perusal system of claim 78, wherein the searchable index comprises a plurality of complementary index files.

80. The data indexing and perusal system of claim 78, wherein the annotation module is operable to store any generated annotations within the searchable index.

81. The data indexing and perusal system of claim 78, wherein the annotation module enables designation of a link term and designation of one of the plurality of selected source files to be linked to the designated link term.

82. The data indexing and perusal system of claim 81, wherein the index module is operable to store any designated link term within the searchable index.

83. The data indexing and perusal system of claim 82, wherein the index module is operable to store links designated through the annotation module only if the links are valid.

84. The data indexing and perusal system of claim 81, wherein the annotation module is operable to automatically generate links between all instances of a designated link term within the plurality of selected source files and the designated file.

85. The data indexing and perusal system of claim 84, wherein the annotation module enables automatic generation of links only if the links are valid.

86. The data indexing and perusal system of claim 78, the system further comprising a browser for displaying the HTML files that meet the search criterion and that utilizes the word locations stored in the searchable index to visually distinguish the searched words and phrases from any surrounding text in the displayed HTML files.

87. The data indexing and perusal system of claim 78, wherein the search module is operable to search a plurality of searchable indexes in a single search.

88. A data indexing and perusal system comprising:

an index module that enables generation of an index of a plurality of selected source files;

a custom link module that enables a user to create links between two of the plurality of selected source files; and

a search module that enables a search to be performed according to a search criterion to locate words and phrases in the plurality of selected source files.

89. The data indexing and perusal system of claim 88, wherein the searchable index comprises a plurality of complementary index files.

90. The data indexing and perusal system of claim 88, wherein the index module is operable to store any custom links within the index.

91. The data indexing and perusal system of claim 88, wherein the link module enables creation of valid custom links only.

92. The data indexing and perusal system of claim 88, wherein the link module enables designation of a link term and designation of one of the plurality of selected source files to be linked to the designated link term;

the link module being operable to automatically link multiple instances of the designated link term in the plurality of selected source files with the designated file.

93. The data indexing and perusal system of claim 88, wherein the selected source files include HTML files, the system further comprising a browser for displaying the HTML files that meet the search criterion and which utilizes word locations retrieved from an index of word locations to visually distinguish the searched words and phrases from any surrounding text in the displayed HTML files.

94. A data indexing and perusal system comprising:

an index module that enables generation of a searchable index of a plurality of HTML files;

a search module that enables a search to be performed of the index according to a search criterion to locate words and phrases in the plurality of HTML files; and

a browser for displaying the HTML files that meet the search criterion and which utilizes word locations retrieved from an index of word locations to visually distinguish the searched words and phrases from any surrounding text in the displayed HTML files.

95. A data indexing and perusal system comprising:

a display module operable to display a web page comprising a plurality of links to displayable web elements from the group consisting of web pages, text, images, and graphics, wherein the web page and web elements have original source internet addresses;

a selection module that enables saving of the web page and selective saving of the linked elements to a local computer data storage device, thereby providing the selectively saved linked elements with local addresses;

the selection module being configured to automatically modify the web page'"'"'s links to the selectively saved linked elements so that they point to the selectively saved linked elements'"'"' local addresses;

an index module that enables generation of a searchable index of the saved web page and the selectively saved linked elements; and

a search module that enables a search to be performed of the index according to a search criterion.

96. The data indexing and perusal system of claim 95, wherein the selection module is operable to save the original source internet addresses of the selectively saved linked elements when modifying the saved web page'"'"'s links to point to the selectively saved linked elements'"'"' local addresses.

97. A method of annotating, indexing, searching, and displaying a plurality of selected source files, the method comprising:

enabling users to generate custom annotations of the plurality of selected source files;

generating a searchable index of the plurality of selected source files;

incorporating any user-generated custom annotations into the index;

searching the searchable index according to a search criterion to locate words and phrases in the plurality of selected source files; and

displaying at least portions of files in the plurality of selected source files that meet the search criterion.

98. The method of claim 97, wherein the step of generating a searchable index creates a searchable index comprising a plurality of complementary index files.

99. The method of claim 97, wherein the enablement step also enables a user to designate a link term and designate one of the plurality of selected source files to be linked to the designated link term.

100. The method of claim 99, further comprising the step of verifying the validity of any designated links, wherein the incorporating step incorporates links only if the links are valid.

101. The method of claim 99, further comprising the step of automatically generating links between all instances of a designated link term within the plurality of selected source files and the designated file.

102. The method of claim 101, wherein the automatic link generation step generates only valid links.

103. The method of claim 101, wherein the index generating step generates an index operable to be searched according to negative searching principles using conflation logic.

104. A method of linking, indexing, and searching a plurality of selected source files, the method comprising:

enabling users to create custom links between two or more of the plurality of selected source files;

generating a searchable index of the plurality of selected source files;

incorporating any user-created custom links into the index; and

searching the searchable index according to a search criterion to locate words and phrases in the plurality of selected source files.

105. The method of claim 104, wherein the step of generating a searchable index creates a searchable index comprising a plurality of complementary index files.

106. The method of claim 104, further comprising the step of verifying the validity of any custom links, wherein the incorporating step incorporates custom links only if the custom links are valid.

107. The method of claim 104, wherein the enablement step enables designation of a link term and designation of one of the plurality of selected source files to be linked to the designated link term;

the link module further comprising the step of automatically generating links between all instances of the link term within the plurality of selected source files and the designated file.

108. The method of claim 104, further comprising the step of displaying at least portions of selected source files that meet the search criterion.

109. The method of claim 108, wherein the selected source files include HTML files, the displaying step displaying the HTML files that meet the search criterion in a manner that visually distinguishes the searched words and phrases from any surrounding text in the displayed HTML files.

110. A method of storing, indexing, and searching information from the internet, the method comprising:

displaying a web page comprising a plurality of links to displayable web elements from the group consisting of web pages, text, images, and graphics, wherein the web page and web elements have original source internet addresses;

selecting at least one of the linked elements for indexing;

saving the web page and the selected linked elements as separate and distinct files to a local computer data storage device, thereby providing the web page and selected linked elements with local addresses;

automatically modifying the web page'"'"'s links to the selected linked elements so that they point to the selected linked elements'"'"' local addresses;

generating a searchable index of the web page and selected link elements; and

searching the index according to a search criterion.

111. The method of claim 110, further comprising:

automatically saving the original source internet addresses of the selected linked elements.

112. An internet browser application that acts as a client to a remote web server and displays HTML files having formatting control tags in a graphical user interface in accordance with the formatting control tags of the HTML files, the internet browser application comprising:

a database selection module that enables a plurality of HTML files to be downloaded and saved into at least one selectable database;

a database index generation module that enables generation of a common searchable index of all files downloaded and saved into a selected database; and

a search module that enables a search to be performed of an index generated by the database index generation module according to a search criterion to locate words and phrases in the files of the selected database.

113. The internet browser application of claim 112, wherein the database index generation module enables generation of a common searchable index that is separate from the downloaded and saved files.

114. The internet browser application of claim 112, wherein the graphical user interface displays at least portions of the HTML files that meet the search criterion in accordance with the formatting control tags of the HTML files.

115. The internet browser application of claim 114, further comprising an index of word locations of words in the HTML files, the internet browser application retrieving word locations of words in the HTML files that meet the search criterion in order to highlight the words in the HTML files that meet the search criterion.

116. The internet browser application of claim 114, wherein the graphical user interface enables users to annotate a downloaded html file.

117. The internet browser application of claim 112, wherein the database index generation module is actuated by saving a file and exiting a browser mode.

118. In an internet browser application that acts as a client to a remote web server and displays HTML files having formatting control tags in a graphical user interface in accordance with the formatting control tags of the HTML files, the improvement comprising:

an index generation module that enables generation of an index of an HTML file displayed in the browser, the index being separate from the downloaded and saved files.

119. The internet browser application of claim 118, further comprising a search module that enables a search to be performed of an index generated by the index generation module according to a search criterion to locate words and phrases in the HTML file.

120. In an internet browser application that acts as a client to a remote web server and displays HTML files having formatting control tags in a graphical user interface in accordance with the formatting control tags of the HTML files, the improvement comprising:

a database selection module that enables a plurality of HTML files to be downloaded and saved into at least one selectable database; and

a search module that enables a search to be performed to locate words and phrases in a plurality of HTML files downloaded and saved in a selectable database;

wherein the graphical user interface displays at least portions of the HTML files that meet the search criterion in accordance with the formatting control tags of the HTML files.

121. In an internet browser application that acts as a client to a remote web server and displays HTML files having formatting control tags in a graphical user interface in accordance with the formatting control tags of the HTML files, and which includes a search module enabling a search to be performed to locate words and phrases in a displayed HTML file according to a search criterion, the improvement comprising:

an index of word locations of words in the displayed HTML file;

wherein the internet browser application uses retrieved word locations of words in the HTML files that meet the search criterion in order to highlight the words in the HTML files that meet the search criterion while displaying the HTML file in accordance with the formatting control tags of the HTML files.

122. A method of identifying a search term in an HTML file comprising:

accessing an index that identifies a word location, relative to the beginning of the HTML file, of the search term within the HTML file;

displaying the HTML file in an HTML viewer; and

highlighting characters in the HTML file at the identified word location.

123. The method of claim 122, wherein the word location comprises a character position, relative to the beginning of the HTML file, of an instance of the search term in the HTML file.

124. The method of claim 123, wherein the character position of a word in the HTML file is determined by a combination of any preceding visible characters in the file and any preceding control tags that cause an HTML viewer to advance a file position pointer.

125. The method of claim 122, wherein the word location comprises a slot position, relative to the beginning of the HTML file, of an instance of the word in the HTML file.

126. The method of claim 122, wherein the word location comprises both a character position and a slot position, relative to the beginning of the HTML file, of an instance of the search term in the HTML file.

127. A method of generating an index of word locations of an HTML file having visible characters and control tags, wherein said word locations can be used to pinpoint and highlight a word in a HTML browser displaying the HTML file, the method comprising:

identifying the lengths of contiguous blocks of visible characters in the HTML file that are not interrupted by control tags;

for each control tag encountered in the HTML file, determining whether the control tag is an incrementing control tag, wherein an incrementing control tag causes an HTML viewer to advance a file position pointer when the control tag is encountered; and

for a word in the HTML file, generating a number identifying the location of the word in the HTML file by adding an amount by which any incrementing control tags preceding the word advance the file position pointer to the lengths of contiguous blocks of visible characters preceding the word.

128. A computer software apparatus comprising:

a user interface that enables a user to enter a Boolean search expression for searching an HTML file, the Boolean search expression comprising a first text string expression, a second text string expression, and a Boolean operator on the first and second text string expressions;

a search module operable to execute the Boolean search expression on the HTML file; and

an HTML viewer adapted to highlight words in the HTML file corresponding to the Boolean search expression while displaying the HTML file in HTML format.

129. A computer software apparatus comprising:

a user interface that enables a user to enter a proximity search expression for searching an HTML file;

a search module operable to execute the proximity search expression on the HTML file; and

an HTML viewer adapted to highlight words in the HTML file corresponding to the proximity search expression while displaying the HTML file in HTML format.

130. A computer software apparatus comprising:

a user interface that enables a user to enter a conflation search expression for searching an HTML file;

a search module operable to execute the conflation search expression on the HTML file; and

an HTML viewer adapted to highlight words in the HTML file corresponding to the conflation search expression while displaying the HTML file in HTML format.

131. A method of displaying words in an HTML file satisfying a Boolean search query performed on the HTML file, wherein the Boolean search expression comprises a first text string expression, a second text string expression, and a Boolean operator on the first and second text string expressions, the method comprising:

for each word satisfying the Boolean search query, accessing an index that identifies the word location, relative to the beginning of the HTML file, of that word;

displaying the HTML file in an HTML viewer; and

highlighting characters in the HTML file at the identified word location.

132. The method of claim 131, wherein the word location comprises a character position, relative to the beginning of the HTML file, of an instance of the search term in the HTML file.

133. The method of claim 132, wherein the character position of a word in the HTML file is determined by a combination of any preceding visible characters in the file and any preceding control tags that cause an HTML viewer to advance a file position pointer.

134. The method of claim 131, wherein the word location comprises a slot position, relative to the beginning of the HTML file, of an instance of the word in the HTML file.

135. The method of claim 131, wherein the word location comprises both a character position and a slot position, relative to the beginning of the HTML file, of an instance of the search term in the HTML file.

136. A method of displaying words in an HTML file satisfying a proximity search query performed on the HTML file, the method comprising:

for each word satisfying the proximity search query, accessing an index that identifies the word location, relative to the beginning of the HTML file, of that word;

displaying the HTML file in an HTML viewer; and

highlighting characters in the HTML file at the identified word location.

137. The method of claim 136, wherein the word location comprises a character position, relative to the beginning of the HTML file, of an instance of the search term in the HTML file.

138. The method of claim 137, wherein the character position of a word in the HTML file is determined by a combination of any preceding visible characters in the file and any preceding control tags that cause an HTML viewer to advance a file position pointer.

139. The method of claim 136, wherein the word location comprises a slot position, relative to the beginning of the HTML file, of an instance of the word in the HTML file.

140. The method of claim 136, wherein the word location comprises both a character position and a slot position, relative to the beginning of the HTML file, of an instance of the search term in the HTML file.

141. A method of displaying words in an HTML file satisfying a conflation search query performed on the HTML file, the method comprising:

for each word satisfying the conflation search query, accessing an index that identifies the word location, relative to the beginning of the HTML file, of that word;

displaying the HTML file in an HTML viewer; and

highlighting characters in the HTML file at the identified word location.

142. The method of claim 141, wherein the word location comprises a character position, relative to the beginning of the HTML file, of an instance of the search term in the HTML file.

143. The method of claim 142, wherein the character position of a word in the HTML file is determined by a combination of any preceding visible characters in the file and any preceding control tags that cause an HTML viewer to advance a file position pointer.

144. The method of claim 141, wherein the word location comprises a slot position, relative to the beginning of the HTML file, of an instance of the word in the HTML file.

145. The method of claim 141, wherein the word location comprises both a character position and a slot position, relative to the beginning of the HTML file, of an instance of the search term in the HTML file.

146. A computer software apparatus comprising:

a user interface that enables a user to enter a search expression for searching an HTML file;

a search module operable to execute the search expression on the HTML file;

an index that identifies a word location, relative to the beginning of the HTML file, of any matching search term within the HTML file; and

an HTML viewer adapted to use the word location to highlight any matching search term in the HTML file corresponding to the search expression while displaying the HTML file in HTML format.

147. The computer software apparatus of claim 146, wherein the word location comprises a character position, relative to the beginning of the HTML file, of an instance of the search term in the HTML file.

148. The computer software apparatus of claim 147, wherein the character position of a word in the HTML file is determined by a combination of any preceding visible characters in the file and any preceding control tags that cause an HTML viewer to advance a file position pointer.

149. The computer software apparatus of claim 146, wherein the word location comprises a slot position, relative to the beginning of the HTML file, of an instance of the word in the HTML file.

150. The computer software apparatus of claim 146, wherein the word location comprises both a character position and a slot position, relative to the beginning of the HTML file, of an instance of the search term in the HTML file.