Data driven component reputation

• US 9,070,086 B2
• Filed: 05/12/2008
• Issued: 06/30/2015
• Est. Priority Date: 05/12/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Garg, Neeraj
• Primary Examiner(s): Miller, Alan S
• Application Number:
  US12/118,760
• Publication Number:
  US 20090281819A1
• Time in Patent Office: 2,605 Days
• Field of Search: 705 711- 742, 714 1- 57
• US Class Current: 1/1
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06Q 50/182 Alternative dispute resolution

Abstract

Various technologies and techniques are disclosed for observing the real-world performance of components and using the collected data to improve other user experiences. Configuration data, usage data, and user experience data are collected for components on observed solution instances. The configuration data, usage data, and user experience data are analyzed to generate component diagnostic data that can be used to make recommendations to one or more advised solution instances as to how to correct a problem being experienced on the one or more advised solution instances. In one implementation, the component diagnostic data generated includes a reputation rating for each of the components.

Claims

1. A method to improve performance on one or more advised instances based on real world usage data of one or more components on observed instances using a processing unit of a processor-based system, the method comprising the steps of:

receiving configuration data regarding at least one component of a plurality of components on a plurality of observed instances,

said receiving the configuration data comprising;

collecting the configuration data by at least one observation agent installed on at least one of one or more instances of the plurality of observed instances or one or more other instances;

receiving usage data regarding at least one component of the plurality of components on the plurality of observed instances;

receiving user experience data, which is programmatically determined, regarding at least one component of the plurality of components on the plurality of observed instances;

generating, by the processing unit, component diagnostic data that can be used to make one or more recommendations to one or more advised instances as to how to correct a problem being experienced on the one or more advised instances based on a comparison of the component diagnostic data and component data related to the one or more advised instances, the comparison indicating one or more components on the one or more advised instances that are associated with one or more components of the plurality of components on the plurality of observed instances that have previously experienced at least one problem, said generating being based on an analysis of the configuration data, the usage data, and the user experience data,

said generating the component diagnostic data comprising;

programmatically determining a rating for each of the plurality of components by the processing unit, each rating indicating a reliability of a respective component of the plurality of components, the component diagnostic data including the rating for each of the plurality of components;

storing the rating for each of the plurality of components in a computer database; and

automatically providing, by the system, the one or more recommendations to the one or more advised instances based on the component diagnostic data, the one or more recommendations specifying at least one change with respect to at least one of the one or more advised instances or one or more usage patterns associated with the one or more advised instances to improve the performance on the one or more advised instances.

2. The method of claim 1, wherein the component diagnostic data that is generated from the generating step includes compatibility information for at least one component of the plurality of components on the plurality of observed instances with respect to at least another component of the plurality of components on the plurality of observed instances.

3. The method of claim 1, wherein the component diagnostic data that is generated from the generating step includes hardware requirements of at least one component of the plurality of components on the plurality of observed instances based upon user experience data.

4. The method of claim 1, wherein the configuration data that is collected includes details regarding software and hardware installed on the plurality of observed instances.

5. The method of claim 1, wherein the usage data that is collected includes details on what purposes the plurality of observed instances are used for most frequently.

6. The method of claim 1, wherein the user experience data is collected automatically based upon performance details of at least one component of the plurality of components on the plurality of observed instances.

7. The method of claim 1, wherein a number of times a particular component of the plurality of components on the plurality of observed instances crashed is included as part of the user experience data that is collected.

8. The method of claim 1, wherein at least a portion of the user experience data is collected as opinion data that is received from one or more users of the plurality of observed instances.

9. The method of claim 1, wherein the component diagnostic data is made available to third parties through a searchable component diagnostic database.

10. The method of claim 1, wherein the configuration data, usage data, and user experience data is collected by an observation agent installed on each of the observed instances and then transmitted to a separate instance for the analyzing step.

11. A system to improve performance on one or more advised instances based on real world usage data of one or more components on observed instances, the system comprising:

a processing unit;

hardware data storage that stores configuration data collected by at least one observation agent installed on at least one of one or more instances of a plurality of observed instances or one or more other instances, usage data, and programmatically determined user experience data regarding at least one component of a plurality of components on the plurality of observed instances;

a data mining engine, implemented using the processing unit, that generates component diagnostic data that can be used to make one or more recommendations to one or more advised instances as to how to correct a problem being experienced on the one or more advised instances based on a comparison of the component diagnostic data and component data related to the one or more advised instances, the comparison indicating one or more components on the one or more advised instances that are associated with one or more components of the plurality of components on the plurality of observed instances that have previously experienced at least one problem, the component diagnostic data being generated based on an analysis of the configuration data, the usage data, and the user experience data,

the data mining engine configured to programmatically determine a rating for each of the plurality of components, each rating indicating a reliability of a respective component of the plurality of components, the component diagnostic data including the rating for each of the plurality of components;

hardware that stores the rating for each of the plurality of components; and

hardware that automatically provides the one or more recommendations to the one or more advised instances based on the component diagnostic data, the one or more recommendations specifying at least one change with respect to at least one of the one or more advised instances or one or more usage patterns associated with the one or more advised instances to improve the performance on the one or more advised instances.

12. The system of claim 11, wherein the component diagnostic data includes compatibility information for at least one component of the plurality of components on the plurality of observed instances with respect to at least another component of the plurality of components on the plurality of observed instances.

13. The system of claim 11, wherein the configuration data includes details regarding software and hardware installed on the plurality of observed instances.

14. The system of claim 11, wherein the usage data includes details on what purposes the plurality of observed instances are used for most frequently.

15. The system of claim 11, further comprising:

at least one data server that automatically collects the user experience data based upon performance details of at least one component of the plurality of components on the plurality of observed instances.

16. The system of claim 11, wherein the user experience data indicates a number of times a particular component of the plurality of components on the plurality of observed instances crashed.

17. The system of claim 11, further comprising:

at least one data server that collects at least a portion of the user experience data as opinion data that is received from one or more users of the plurality of observed instances.

18. An article comprising a hardware storage medium having computer-executable instructions for causing a computer to improve performance on one or more advised instances based on real world usage data of one or more components on observed instances, the hardware storage medium comprising:

first instructions for enabling the computer to collect configuration data collected by at least one observation agent installed on at least one of one or more instances of a plurality of observed instances or one or more other instances, usage data, and programmatically determined user experience data regarding at least one component of a plurality of components on the plurality of observed instances, the first instructions for enabling the computer to automatically collect the user experience data based upon performance details of at least one component of the plurality of components on the plurality of observed instances;

second instructions for enabling the computer to analyze the configuration data, the usage data, and the user experience data;

third instructions for enabling the computer to generate component diagnostic data that can be used to make one or more recommendations to one or more advised instances as to how to correct a problem being experienced on the one or more advised instances based on a comparison of the component diagnostic data and component data related to the one or more advised instances, the comparison indicating one or more components on the one or more advised instances that are associated with one or more components of the plurality of components on the plurality of observed instances that have previously experienced at least one problem, the component diagnostic data being generated based on an analysis of the configuration data, the usage data, and the user experience data,

the third instructions comprising;

instructions for enabling the computer to programmatically determine a rating for each of the plurality of components, each rating indicating a reliability of a respective component of the plurality of components, the component diagnostic data including the rating for each of the plurality of components; and

fourth instructions for enabling the computer to automatically provide the one or more recommendations to the one or more advised instances based on the component diagnostic data, the one or more recommendations recommending at least one change with respect to at least one of the one or more advised instances or one or more usage patterns associated with the one or more advised instances to improve the performance on the one or more advised instances.

19. The article of claim 18, wherein the user experience data indicates a number of times a particular component of the plurality of components on the plurality of observed instances crashed.

20. The article of claim 18, wherein the user experience data includes opinion data that is received from one or more users of the plurality of observed instances.