System for collecting specific information from several sources of unstructured digitized data

• US 6,694,307 B2
• Filed: 03/07/2001
• Issued: 02/17/2004
• Est. Priority Date: 03/07/2001
• Status: Expired due to Term

• Current Assignee: Generate Canada ULC
• Original Assignee: Netvention
• Inventors: Julien, Benoit
• Primary Examiner(s): JUNG, DAVID YIUK
• Application Number:
  US09/800,562
• Publication Number:
  US 20020129011A1
• Time in Patent Office: 1,077 Days
• Field of Search: 707/1, 707/10, 707/200-206, 707/100-104
• US Class Current: 707/706
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9532 Query formulation
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: Y10S 707/918 Location
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99935 Query augmenting and refining, e.g. inexact access
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

A system for collecting specific information from several sources of unstructured digitized data. The system receives at least one instruction governing the collection of the specific information. The system includes a processing unit operative to analyze the contents of several sources of unstructured digitized data to identify therein information elements relevant to the specific information, at least in part on the basis of the received instruction(s). The processing unit extracts the identified information elements from each source of unstructured digitized data where information elements have been identified, and processes the extracted information elements for generating an output signal conveying the specific information.

Claims

1. A system for collecting specific information from several sources of unstructured digitized data, said system comprising:

a) an input for receiving at least one instruction governing the collection of the specific information;

b) a processing unit coupled to said input, said processing unit operative to;

i) establish a data connection with a plurality of sources of unstructured digitized data from which the specific information is to be collected, at least in part on the basis of the at least one instruction;

ii) analyse the contents of each one of said plurality of sources of unstructured digitized data to identify information elements relevant to the specific information;

iii) extract the identified information elements from each source of unstructured digitized data where information elements have been identified;

iv) process the extracted information elements for generating an output signal conveying at least a portion of the specific information, said processing including;

for each source of unstructured digitized data, correlating the information elements extracted therefrom on the basis of predetermined clustering rules for assembling the extracted information elements into coherent information relevant to the specific information;

compiling the coherent information assembled from the plurality of sources of unstructured digitized data into said at least a portion of the specific information; and

discarding redundant information from said at least a portion of the specific information;

c) an output coupled to said processing unit for releasing said output signal from said system.

2. A system as defined in claim 1, wherein said at least one instruction conveys at least one location where the collection of the specific information is to take place.

3. A system as defined in claim 2, wherein said at least one instruction conveys at least one URL address indicating the address of a source of unstructured digitized data, each URL address being in a form such that said processing unit can access the source and import the unstructured digitized data from the source.

4. A system as defined in claim 3, wherein said plurality of sources of unstructured digitized data are pages of the World Wide Web (WWW), each URL address indicating the address of a page of the WWW potentially including at least one connection to a different page of the WWW.

5. A system as defined in claim 4, wherein said system further includes a prospector unit coupled to said input, said prospector unit in data communication with at least one search engine capable to search the WWW on the basis of query requests formulated by said prospector unit.

6. A system as defined in claim 5, wherein said prospector unit receives at least one search parameter from a user, said prospector operative to:

a) generate a query request on the basis of the at least one search parameter;

b) send the query request to the search engine;

c) receive a response to the query request from the search engine including at least one URL address indicating the address of a WWW page containing information related to the at least one search parameter;

d) process the response and generate an instruction including the at least one URL address returned by the search engine;

e) transmit said instruction to said input of said system.

7. A system as defined in claim 6, wherein said processing unit is responsive to the instruction received from said prospector unit for extracting therefrom the at least one URL address returned by the search engine, said processing operative to collect the specific information from the WWW pages connected to the at least one URL address returned by the search engine.

8. A system as defined in claim 6, wherein said prospector unit receives a response to the query request from the search engine including a plurality of URL addresses, each URL address indicating the address of a WWW page containing information related to the at least one search parameter, said prospector unit being further operative to:

a) select a particular URL address from said plurality of URL addresses returned by the search engine on the basis of said at least one search parameter;

b) discard the unselected URL addresses;

c) generate an instruction including the selected URL address;

d) transmit said instruction to said input of said system.

9. A system as defined in claim 8, wherein the specific information is business information.

10. A system as defined in claim 9, wherein the at least one search parameter is the name of a company.

11. A system as defined in claim 10, wherein the selected URL address indicates the address of the home page for the company.

12. A system as defined in claim 3, wherein said processing unit performs lexical analysis and text interpretation operations for identifying information elements relevant to the specific information in each source of unstructured digitized data.

13. A system as defined in claim 12, wherein the lexical analysis and text interpretation operations are performed by said processing unit at least in part on the basis of a plurality of dictionaries.

14. A system as defined in claim 12, wherein, for each source of unstructured digitized data where information elements have been identified, said processing unit is operative to establish relationships between the identified information elements at least in part on the basis of predetermined clustering rules, for assembling the identified information elements into coherent information relevant to the specific information.

15. A system as defined in claim 14, wherein said processing unit is operative to process said coherent information generated from all of the sources of unstructured digitized data in which information elements relevant to the specific information were identified, for removing repetitive information and combining complementary information.

16. A system as defined in claim 1, wherein said processing unit generates a data structure holding the specific information, said output signal including the data structure.

17. A system as defined in claim 16, wherein said data structure is a list.

18. A system as defined in claim 16, wherein said data structure is a table.

19. A system as defined in claim 1, wherein each source of unstructured digitized data is selected from the group consisting of a WWW page, a database, a server, a memory module, a text file and a digitized document.

20. A system as defined in claim 1, wherein the specific information is business information.

21. A system as defined in claim 20, wherein the specific information is contact information for prospecting potential clients.

22. A system as defined in claim 21, wherein the information elements relevant to the contact information are selected from the group consisting of business name, business description, telephone number, fax number, postal address, street name, city, country, region, postal code, e-mail address, name of a contact person and title of a contact person.

23. A computer readable storage medium containing a program element for execution by a computing apparatus to implement a system for collecting specific information from several sources of unstructured digitized data, said system including:

a) an input for receiving at least one instruction governing the collection of the specific information;

b) a processing unit coupled to said input, said processing unit operative to;

i) establish a data connection with a plurality of sources of unstructured digitized data from which the specific information is to be collected, at least in part on the basis of the at least one instruction;

ii) analyse the contents of each one of said plurality of sources of unstructured digitized data to identify information elements relevant to the specific information;

iii) extract the identified information elements from each source of unstructured digitized data where information elements have been identified;

iv) process the extracted information elements for generating an output signal conveying at least a portion of the specific information, said processing including;

for each source of unstructured digitized data, correlating the information elements extracted therefrom on the basis of predetermined clustering rules for assembling the extracted information elements into coherent information relevant to the specific information;

compiling the coherent information assembled from the plurality of sources of unstructured digitized data into said at least a portion of the specific information; and

discarding redundant information from said at least a portion of the specific information;

c) an output coupled to said processing unit for releasing said output signal from said system.

24. A computer readable storage medium as defined in claim 23, wherein said at least one instruction conveys at least one location where the collection of the specific information is to take place.

25. A computer readable storage medium as defined in claim 24, wherein said at least one instruction conveys at least one URL address indicating the address of a source of unstructured digitized data, each URL address being in a form such that a machine can access the source and import the unstructured digitized data from the source.

26. A computer readable storage medium as defined in claim 25, wherein said plurality of sources of unstructured digitized data are pages of the World Wide Web (WWW), each URL address indicating the address of a page of the WWW potentially including at least one connection to a different page of the WWW.

27. A computer readable storage medium as defined in claim 25, wherein said processing unit performs lexical analysis and text interpretation operations for identifying information elements relevant to the specific information in each source of unstructured digitized data.

28. A computer readable storage medium as defined in claim 27, wherein the lexical analysis and text interpretation operations are performed by said processing unit at least in part on the basis of a plurality of dictionaries.

29. A computer readable storage medium as defined in claim 27, wherein, for each source of unstructured digitized data where information elements have been identified, said processing unit is operative to establish relationships between the identified information elements at least in part on the basis of predetermined clustering rules, for assembling the identified information elements into coherent information relevant to the specific information.

30. A computer readable storage medium as defined in claim 29, wherein said processing unit is operative to process said coherent information generated from all of the sources of unstructured digitized data in which information elements relevant to the specific information were identified, for removing repetitive information and combining complementary information.

31. A computer readable storage medium as defined in claim 23, wherein said processing unit generates a data structure holding the specific information, said output signal including the data structure.

32. A computer readable storage medium as defined in claim 31, wherein said data structure is a list.

33. A computer readable storage medium as defined in claim 31, wherein said data structure is a table.

34. A computer readable storage medium as defined in claim 23, wherein each source of unstructured digitized data is selected from the group consisting of a WWW page, a database, a server, a memory module, a text file and a digitized document.

35. A computer readable storage medium as defined in claim 23, wherein the specific information is business information.

36. A computer readable storage medium as defined in claim 35, wherein the specific information is contact information for prospecting potential clients.

37. A computer readable storage medium as defined in claim 36, wherein the information elements relevant to the contact information are selected from the group consisting of business name, business description, telephone number, fax number, postal address, street name, city, country, region, postal code, e-mail address, name of a contact person and title of a contact person.

38. A data processing device for collecting specific information from several sources of unstructured digitized data, said data processing device comprising:

a) an input for receiving at least one instruction governing the collection of the specific information;

b) an identification unit coupled to said input, said identification unit operative to;

i) establish a data connection with a plurality of sources of unstructured digitized data from which the specific information is to be collected, at least in part on the basis of the at least one instruction;

ii) analyse the contents of each one of said plurality of sources of unstructured digitized data to identify information elements relevant to the specific information;

c) an extractor unit operative to extract the identified information elements from each source of unstructured digitized data where information elements have been identified;

d) an aggregator unit operative to process the extracted information elements for generating an output signal conveying at least a portion of the specific information, said processing including;

for each source of unstructured digitized data, correlating the information elements extracted therefrom on the basis of predetermined clustering rules for assembling the extracted information elements into coherent information relevant to the specific information;

compiling the coherent information assembled from the plurality of sources of unstructured digitized data into said at least a portion of the specific information; and

discarding redundant information from said at least a portion of the specific information;

e) an output for releasing said output signal from said data processing device.

39. A data processing device as defined in claim 38, wherein said at least one instruction conveys at least one location where the collection of the specific information is to take place.

40. A data processing device as defined in claim 39, wherein said at least one instruction conveys at least one URL address indicating the address of a source of unstructured digitized data, each URL address being in a form such that a machine can access the source and import the unstructured digitized data from the source.

41. A data processing device as defined in claim 40, wherein said plurality of sources of unstructured digitized data are pages of the World Wide Web (WWW), each URL address indicating the address of a page of the WWW potentially including at least one connection to a different page of the WWW.

42. A data processing device as defined in claim 40, wherein said identification unit performs lexical analysis and text interpretation operations for identifying information elements relevant to the specific information in each source of unstructured digitized data.

43. A data processing device as defined in claim 42, wherein the lexical analysis and text interpretation operations are performed by said identification unit at least in part on the basis of a plurality of dictionaries.

44. A data processing device as defined in claim 42, wherein, for each source of unstructured digitized data from which identified information elements have been extracted by said extraction unit, said aggregator unit is operative to establish relationships between the extracted information elements at least in part on the basis of predetermined clustering rules, for assembling the identified information elements into coherent information relevant to the specific information.

45. A data processing device as defined in claim 44, wherein said aggregator unit is operative to process said coherent information generated from all of the sources of unstructured digitized data where information elements relevant to the specific information were identified and extracted, for removing repetitive information and combining complementary information.

46. A data processing device as defined in claim 38, wherein said aggregator unit generates a data structure holding the specific information, said output signal including the data structure.

47. A data processing device as defined in claim 46, wherein said data structure is a list.

48. A data processing device as defined in claim 46, wherein said data structure is a table.

49. A data processing device as defined in claim 38, wherein each source of unstructured digitized data is selected from the group consisting of a WWW page, a database, a server, a memory module, a text file and a digitized document.

50. A data processing device as defined in claim 38, wherein the specific information is business information.

51. A data processing device as defined in claim 50, wherein the specific information is contact information for prospecting potential clients.

52. A data processing device as defined in claim 51, wherein the information elements relevant to the contact information are selected from the group consisting of business name, business description, telephone number, fax number, postal address, street name, city, country, region, postal code, e-mail address, name of a contact person and title of a contact person.

53. A method for collecting specific information from several sources of unstructured digitized data, said method comprising:

a) receiving at least one instruction governing the collection of the specific information;

b) establishing a data connection with a plurality of sources of unstructured digitized data from which the specific information is to be collected, at least in part on the basis of the at least one instruction;

c) analyzing the contents of each one of the plurality of sources of unstructured digitized data to identify information elements relevant to the specific information;

d) extracting the identified information elements from each source of unstructured digitized data where information elements have been identified;

e) processing the extracted information elements for generating an output signal conveying at least a portion of the specific information, said processing including;

for each source of unstructured digitized data, correlating the information elements extracted therefrom on the basis of predetermined clustering rules for assembling the extracted information elements into coherent information relevant to the specific information;

compiling the coherent information assembled from the plurality of sources of unstructured digitized data into said at least a portion of the specific information; and

discarding redundant information from said at least a portion of the specific information.