Diagnostic report improvement utilizing unobtrusive workflow logging

• US 7,653,611 B2
• Filed: 03/30/2005
• Issued: 01/26/2010
• Est. Priority Date: 03/30/2005
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Jacobs, Nancy E., Kim, Pyungchul, Zheng, Zijian, Mydland, Mark B.
• Primary Examiner(s): Cottingham; John R.
• Assistant Examiner(s): Arjomandi; Noosha
• Application Number:
  US11/093,546
• Publication Number:
  US 20060241908A1
• Time in Patent Office: 1,763 Days
• Field of Search: None
• US Class Current: 705/7.41
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
• CPC Class Codes: G06Q 10/06395 Quality analysis or management

Abstract

The subject invention leverages data logging of responses to diagnostic reports to provide data that can be mined for diagnostic report quality information. Instances of the subject invention provide an initial diagnostic report assessment means to facilitate review by an entity. The entity'"'"'s responses to the sorted diagnostic reports are logged unobtrusively to create diagnostic report quality data. This data is then analyzed by an analysis means that can then adjust the assessment means to improve its performance. In this manner, the performance of the assessment means is increased while reducing the workload of the entity reviewing the diagnostic reports. Other instances of the subject invention facilitate to increase the performance of a diagnostic report generating means as well. Instances of the subject invention can also employ machine learning techniques to facilitate in analyzing the quality data and/or in assessing the diagnostic reports.

Claims

1. A system that utilizes data mining, comprising:

at least one processor that executes the following computer executable components stored on at least one computer readable storage medium;

an assessment model component that receives at least one diagnostic report from a diagnostic report generating system and generates a quality assessment of each report for an entity, wherein the diagnostic report generating system generates the at least one diagnostic report and wherein the at least one diagnostic report is associated with an analysis of a query by a disparate entity and comprises suggestions associated with the query;

a logging component that creates a quality data log in response to entity'"'"'s action with regard to the utilization of each suggestion in each of the diagnostic reports; and

an analysis component that determines the quality of the at least one diagnostic report based in part on an analysis of the quality data log to facilitate in improving the at least one diagnostic report and the quality assessment by the assessment model component, wherein the analysis component improves an analysis mechanism of an assistant platform (AP), wherein the diagnostic reports and the each suggestion are sorted based on the analysis so that the entity can work on high quality suggestions first, wherein the analysis component determines improvements for the assessment model component via analysis of, at least in part, situations which provide suggestions that are not utilized by the entity, wherein the analysis component determines improvements for the assessment model component via analysis of, at least in part, situations which provide suggestions that are accepted by the entity, and wherein the analysis component utilizes machine learning techniques to facilitate in improving at least one of the assessment model component and the diagnostic report generating system.

2. The system of claim 1, the entity comprising an author associated with a software product.

3. The system of claim 1, wherein the assessment model component employs a highest to lowest confidence sorting technique.

4. The system of claim 1, the logging component comprising a workflow logging component that logs a software product author'"'"'s responses.

5. The system of claim 1, wherein the logging component logs a suggestion in a diagnostic report as useful when the entity takes an action suggested by the suggestion.

6. The system of claim 1, wherein the system is employed to improve the entity'"'"'s performance.

7. The system of claim 1, wherein the system operates non-intrusively with regard to the entity.

8. A method of utilizing data mining, comprising:

employing at least one processor to execute computer executable instructions stored on at least one computer readable storage medium to perform the following acts;

receiving at least one diagnostic report containing suggestions from a diagnostic report generating system, wherein the diagnostic report generating system generates the at least one diagnostic report and wherein the at least one diagnostic report is associated with an analysis of a query by a user and comprises suggestions associated with the query;

employing an assessment model to assess a value of the at least one diagnostic report;

interacting with an entity to facilitate unobtrusively logging the entity'"'"'s response associated with a review of the at least one diagnostic report, wherein the entity is disparate from the user;

analyzing the logged responses to improve the performance of the assessment model;

sorting disparate diagnostic reports and suggestions received from the diagnostic report generating system based in part on the analysis to provide the entity with high quality suggestions first; and

altering the assessment model and the diagnostic report generating system based upon the analysis to facilitate improving its performance with regard to diagnostic reporting by improving at least one of generation of the at least one diagnostic report and assessment of the improved at least one diagnostic report based on the analysis;

logging a suggestion in the diagnostic report as not useful when the entity rejects an action suggested by the suggestion; and

employing machine learning techniques to facilitate in improving performance of at least one of the assessment model and the diagnostic report generating system.

9. The method of claim 8, the entity comprising an author associated with a software product.

10. The method of claim 8, the diagnostic report generating system comprising an assistant platform.

11. The method of claim 8, wherein the method is employed to improve an entity'"'"'s performance.

12. The method of claim 8, wherein the assessment model utilizes a highest to lowest confidence sorting technique.

13. The method of claim 8, wherein the method process unobtrusively with regard to the entity.

14. The method of claim 8 further comprising:

logging a suggestion in a diagnostic report as useful when the entity takes an action suggested by the suggestion.

15. A system that utilizes data mining, comprising:

at least one processor;

at least one computer readable storage medium storing computer executable instructions that when executed by the at least one processor implement components comprising;

means for receiving at least one diagnostic report from a diagnostic report generating system, wherein the diagnostic report generating system generates the at least one diagnostic report and wherein the at least one diagnostic report is associated with an analysis of a query by a user and includes suggestions associated with the query;

means for generating a quality assessment of each diagnostic report for an entity, wherein the entity disparate is from the user;

means for creating a quality data log in response to the entity'"'"'s action with regard to the utilization of each of the diagnostic reports;

means for sorting the at least one diagnostic report and suggestions contained in the at least one diagnostic report based in part on an analysis of the quality data log to provide the entity with a highest quality suggestion first; and

means for employing the quality data log to facilitate in improving at least one of the quality assessment and the diagnostic report generating system by improving generation of the at least one diagnostic report and assessment of the improved at least one diagnostic report based on the analysis, wherein means for employing the quality data log determines improvements for the means for generating a quality assessment via analysis of, at least in part, situations which provide suggestions that are not utilized by the entity, wherein the means for employing the quality data log determines improvements for the means for generating a quality assessment via analysis of, at least in part, situations which provide suggestions that are accepted by the entity, and wherein the means for employing the quality data log utilizes machine learning techniques to facilitate in improving at least one of the means for generating a quality assessment and the diagnostic report generating system.

16. The system of claim 15, wherein the entity comprises an author associated with a software product.

17. The system of claim 15, wherein the means for sorting employs a highest to lowest confidence sorting technique.

18. The system of claim 15, wherein the system is employed to improve the entity'"'"'s performance.

19. The system of claim 15, wherein the system operates non-intrusively with regard to the entity.

20. The system of claim 15, wherein the diagnostic report generating system comprises an assistant platform.