System and method for collecting and processing data

• US 9,582,611 B2
• Filed: 03/24/2014
• Issued: 02/28/2017
• Est. Priority Date: 09/11/2006
• Status: Active Grant

• Current Assignee: Willow Acquisition Corporation
• Original Assignee: Willow Acquisition Corporation
• Inventors: Ghuneim, Mark D, Dennebaum, Matthew R, Norlander, Dustin J
• Primary Examiner(s): Mamillapalli, Pavan
• Application Number:
  US14/223,987
• Publication Number:
  US 20140207733A1
• Time in Patent Office: 1,072 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/9038 Presentation of query results
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation

Abstract

A system and method for collecting and processing data over a communications network. A data mining marshaller module associates each plugin to a particular data source and manages the plugin to periodically retrieve unstructured data from the data source based on a plurality of data items to be monitored on behalf of a plurality of users. The plugins convert unstructured data received from the data sources to structured data and the data marshaller module stores the structured data in a database. This enables the system and method to aggregate and display the structured data in multiple graphical representations according to the user'"'"'s preference.

Claims

1. A system for collecting and processing data over a communications network, comprising:

a processor based web server comprising;

a data mining marshaller (DMM) module configured to group each information requests from a plurality of users based on a requested subject matter, establish a plugin to retrieve data item representing the requested subject matter, and assign all said information requests for the requested subject matter from the plurality of users to a same plugin;

a plurality of plugins stored in the server, each plugin configured to;

retrieve unstructured data from a data source in response to requests from the plurality of users over the communications network;

convert the unstructured data by parsing the unstructured data into structured data comprising historical data and an analytical graphical representation;

provide the structured data for the plurality of users based on shared interest in the similar subject matter of the associated data item; and

a database to store the structured data received from said plurality of plugins.

2. The system of claim 1, wherein the DMM module is configured to (i) determine if a data item needs to be updated, and (ii) manage a plugin associated with the data item to update the data item.

3. The system of claim 1, wherein the DMM module is configured to measure impact of advertisement campaigns based on engagement correlated with expressions occurring in social media sources.

4. The system of claim 1, wherein the DMM module is configured to measure impact of advertisement campaigns based on engagement correlated with blog comments.

5. The system of claim 1, wherein the DMM module is configured to measure trends and impact of advertisement campaigns in social media.

6. The system of claim 1, wherein the processor based web server further comprises a display navigation module configured to display the stored structured data received in response to a data item associated with a user in a plurality of graphical representations selectable by the user.

7. The system of claim 6, wherein the display navigation module is further configured to:

drill down to the associated data sources from data points on a graph selected by the user; and

overlay data from different data sources selected by the user on at least one graph.

8. A non-transitory computer-readable medium comprising a code for collecting and processing data over a communications network, the code when executed by at least one computer processor comprising functionality to:

group each information requests from a plurality of users based on a requested subject matter;

establish a plugin to retrieve data item representing the requested subject matter;

assign all said information requests for the requested subject matter from the plurality of users to a same plugin;

configure the plurality of plugins stored in processor based web server, each plugin configured to;

retrieve unstructured data from a data source in response to requests from the plurality of users over the communications network;

convert the unstructured data by parsing the unstructured data into structured data comprising historical data and an analytical graphical representation;

provide the structured data for the plurality of users based on shared interest in the similar subject matter of the associated data item; and

storing said structured data received from said plurality of plugins in a database.

9. The computer-readable medium of claim 8, wherein the code further comprises functionality to (i) determine if a data item needs to be updated, and (ii) manage a plugin associated with the data item to update the data item.

10. The computer-readable medium of claim 8, wherein the code further comprises functionality to measure impact of advertisement campaigns based on at least one of:

engagement correlated with expressions occurring in social media sources or engagement correlated with blog comments.

11. The computer-readable medium of claim 8, wherein the code further comprises functionality to measure trends and impact of advertisement campaigns in social media.

12. The computer-readable medium of claim 8, wherein the code further comprises functionality to display the stored structured data received in response to a data item associated with a user in a plurality of graphical representations selectable by the user.

13. The computer-readable medium of claim 12, wherein the code further comprises functionality to drill;

down to the associated data sources from data points on a graph selected by the user; and

overlay data from different data sources selected by the user on at least one graph.

14. A computer based method for collecting and processing data over a communications network, comprising the steps of:

grouping each information requests from a plurality of users based on a requested subject matter;

establishing a plugin to retrieve data item representing the requested subject matter;

assigning all said information requests for the requested subject matter from the plurality of users to a same plugin;

configuring the plurality of plugins stored in processor based web server, each plugin configured to;

retrieve unstructured data from a data source in response to requests from the plurality of users over the communications network,

convert, by a computer processor, the unstructured data by parsing the unstructured data into structured data comprising historical data and an analytical graphical representation,

provide, by the computer processor, the structured data for the plurality of users based on shared interest in the similar subject matter of the associated data item; and

storing said structured data received from said plurality of plugins in a database.

15. The method of claim 14, further comprising the steps of:

determining if a data item needs to be updated; and

managing a plugin associated with the data item to update the data item.

16. The method of claim 14, further comprising the step of measuring impact of advertisement campaigns based on engagement correlated with expressions occurring in social media sources.

17. The method of claim 14, further comprising the step of measuring impact of advertisement campaigns based on engagement correlated with blog comments.

18. The method of claim 14, further comprising the step of measuring trends and impact of advertisement campaigns in social media.

19. The method of claim 14, further comprising the step of displaying the stored structured data received in response to a data item associated with a user in a plurality of graphical representations selectable by the user.

20. The method of claim 19, further comprising the steps of:

drilling down to the associated data sources from data points on a graph selected by the user; and

overlaying data from different data sources selected by the user on at least one graph.