SYSTEMS AND METHODS OF ASSESSING SOFTWARE QUALITY FOR HARDWARE DEVICES

• US 20140157238A1
• Filed: 11/30/2012
• Published: 06/05/2014
• Est. Priority Date: 11/30/2012
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Widjaja, Herman, Frost, Todd, Popov, Dimitar, Fokin, Sergey, Mohamed, Ahmed Zakaria, Chui, Kam Ming
• Application Number:
  US13/691,393
• Publication Number:
  US 20140157238A1
• Time in Patent Office: Days
• US Class Current: 717/126
• CPC Class Codes: G06F 11/3062 where the monitored property is the power consumption power management in a computing system G06F1/3203
• CPC Class Codes: G06F 11/3668 Software testing software testing in telephone exchanges H04M3/242, testing of hardware G06F11/22
• CPC Class Codes: G06F 11/3672 Test management
• CPC Class Codes: G06F 11/3676 for coverage analysis
• CPC Class Codes: G06F 9/4411 Configuring for operating with peripheral devices; Loading of device drivers
• CPC Class Codes: G06Q 10/063 Operations research, analysis or management
• CPC Class Codes: G06Q 10/0639 Performance analysis of employees; Performance analysis of enterprise or organisation operations
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data

Abstract

Systems and techniques of monitoring, assessing and determining the quality of software components and/or their associated features that may be designed and built to be run on a plurality of hardware devices. Such hardware devices may be devices made by different manufacturers. In addition, certain of these manufacturers may be device partners with the software maker. Software product and/or components may be subjected to test runs on various hardware devices and the results may be correlated. This pass/fail data may also be correlated against a number of additional factors—e.g., the market share of device products for which a software product has a minimum level of acceptable or passing rates.

Claims

1. A method for testing the quality of software components, said software components designed to be executed on at least one hardware device wherein said at least one hardware component capable of being commercially available, the steps of said method comprising:

inputting a set of market data regarding said at least one hardware device;

inputting a set of test results of said software components being tested on said at least one hardware component; and

upon the satisfaction of a set of conditions, taking an action regarding the commercial release of said software components for said at least one hardware component.

2. The method of claim 1 wherein said market data further comprises the share of the market possessed by said at least one hardware device.

3. The method of claim 2 wherein said market data further comprises one of a group, said group comprising:

current market share data, historical market share data and new-to-market data.

4. The method of claim 3 wherein said at least one hardware device comprises a plurality of hardware devices for which said software components are designed to be executed.

5. The method of claim 4 wherein the step of inputting a set of market data further comprises:

inputting a set of market data regarding a plurality of devices for which said software components are designed to be executed.

6. The method of claim 5 wherein the step of inputting a set of test results further comprises:

finding all pass/fails results for a set of test runs;

correlating said pass/fail results against said plurality of devices; and

storing the correlation to an electronic storage.

7. The method of claim 6 wherein the method further comprises the step of:

inputting a set of customer data regarding the quality of software execution upon said plurality of devices.

8. The method of claim 7 wherein the method further comprises the step of:

correlating the set of customer data of software reports with a given device.

9. The method of claim 5 wherein said set of conditions further comprises one of a group, said group comprising:

a threshold number of passing test runs on a given device, a threshold number of passing test runs for a set of devices, a threshold number of passing test runs for a given market share of devices, a threshold number of passing test runs for a given set of device capabilities.

10. The method of claim 5 wherein said set of conditions further comprises one of a group, said group comprising:

a threshold number of failing test runs on a given device, a threshold number of failing test runs for a set of devices, a threshold number of failing test runs for a given market share of devices, a threshold number of failing test runs for a given set of device capabilities.

11. The method of claim 5 wherein the step of taking an action comprises one of a group, said group comprising:

ordering the release of said software component, making a recommendation regarding the release of said software component.

12. The method of claim 5 wherein at least one said hardware device is associated with a device manufacturer.

13. The method of claim 12 wherein said device manufacturer comprises a device partner.

14. The method of claim 13 wherein said method further comprises the step of:

finding all information assigned to said device partners;

prioritizing said information; and

providing said information to said device partners.

15. The method of claim 14 wherein said information comprises information related to driver quality.

16. A system for testing the quality of software components, said software components designed to be executed on at least one hardware device wherein said at least one hardware component capable of being commercially available, said system comprising:

a processor, said processor capable of receiving input, wherein said input comprises a set of market data regarding said at least one hardware device and further wherein said input further comprises a set of test results of said software components being tested on said at least one hardware component; and

wherein further said processor is capable of taking an action upon the satisfaction of a set of conditions regarding the commercial release of said software components for at least one hardware component.

17. The system of claim 16 wherein said processor is further capable of:

finding all pass/fails results for a set of test runs;

correlating said pass/fail results against said plurality of devices; and

storing the correlation to an electronic storage.

18. A computer readable storage medium, said computer readable storage medium having computer-executable instructions stored thereon that, when executed by a processor, cause said processor to execute:

a method for testing the quality of software components, said software components designed to be executed on at least one hardware device wherein said at least one hardware component capable of being commercially available, the steps of said method comprising;

inputting a set of market data regarding said at least one hardware device;

inputting a set of test results of said software components being tested on said at least one hardware component; and

upon the satisfaction of a set of conditions, taking an action regarding the commercial release of said software components for said at least one hardware component.

19. The computer readable storage medium of claim 18 wherein said step of inputting a set of test results further comprises:

finding all pass/fails results for a set of test runs;

correlating said pass/fail results against said plurality of devices; and

storing the correlation to an electronic storage.

20. The computer readable storage of claim 18 wherein said method further comprises:

inputting a set of customer data regarding the quality of software execution upon said plurality of devices.