DEVICE AND METHOD FOR EVALUATING SYSTEM PERFORMANCE

• US 20150269051A1
• Filed: 07/31/2013
• Published: 09/24/2015
• Est. Priority Date: 07/31/2012
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd. (Samsung Group), SungKyunKwan University's Research & Business Foundation (SungKyunKwan University (SKKU))
• Original Assignee: Samsung Electronics Co. Ltd. (Samsung Group), SungKyunKwan University's Research & Business Foundation (SungKyunKwan University (SKKU))
• Inventors: Park, Ji-Hoon, Lee, Seung-Wook, Jeon, Jae-Wook, Cho, Seong-Jin, Yoon, Seung-Hyun
• Application Number:
  US14/418,696
• Publication Number:
  US 20150269051A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/3058 Monitoring arrangements for monitoring environmental properties or parameters of the computing system or of the computing system component, e.g. monitoring of power, currents, temperature, humidity, position, vibrations thermal management in cooling arrangements of a computing system G06F1/206
• CPC Class Codes: G06F 11/3409 for performance assessment
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: G06Q 10/0639 Performance analysis of employees; Performance analysis of enterprise or organisation operations

Abstract

A device and a method for evaluating the performance of a system on the basis of a user experience are disclosed. To this end, experience information of a user according to the driving of an embedded system is collected on the basis of a predetermined or preset condition, and a scenario selection condition is set in order to select a scenario for evaluating the performance of the embedded system. An experience pattern of the user is analyzed by requisite experience information obtained from the collected experience information on the basis of the set scenario selection condition, and an optimal scenario for evaluating the performance of the embedded system is selected among a plurality of available scenarios on the basis of the results according to the analysis, thereby evaluating the performance of the embedded system using the selected scenario.

Claims

1. A method for evaluating performance of an embedded system in a performance evaluation apparatus, the method comprising:

obtaining requisite experience information from a database built in advance based on user experience information in using the embedded system, under a predetermined condition for scenario selection;

determining a performance evaluation scenario in consideration of the obtained requisite experience information; and

evaluating performance of the embedded system according to the determined performance evaluation scenario.

2. The method of claim 1, further comprising:

collecting user experience information in driving the embedded system based on a condition arranged or set in advance; and

building the database based on the collected user experience information.

3. The method of claim 1, wherein determining the performance evaluation scenario comprises

analyzing an experience pattern of a user in using the embedded system with the obtained requisite experience information;

and

designing a performance evaluation scenario based on the analyzed experience pattern of the user.

4. The method of claim 3, wherein designing the performance evaluation scenario comprises

defining at least one performance evaluation scenario in advance, each corresponding to one of a plurality of experience patterns;

and

selecting a performance evaluation scenario for selecting performance of the embedded system from among the at least one performance evaluation scenario, each determined in advance to correspond to one of the plurality of experience patterns, according to the analyzed experience pattern of the user.

5. The method of claim 1, wherein evaluating the performance comprises

running at least one evaluation program in the embedded system according to the determined performance evaluation scenario, and analyzing performance of at least one component subject to evaluation, which is involved in running the at least one evaluation program, among components of the embedded system.

6. The method of claim 5, wherein the component subject to evaluation includes at least one of a central processing unit, a graphic processing unit, and a hardware platform, included in the embedded system.

7. The method of claim 1, wherein the experience information includes identification information and location for the embedded system, and information about a type of a program used, a running frequency of each program, a running time of each program, a user'"'"'s gender, age, and weather and wherein the condition for scenario selection is information used as a basis for sorting out the experience information and defined by at least one of the identification information of the embedded system, the user'"'"'s gender, the user'"'"'s age, and location.

8. A performance evaluation apparatus for evaluating performance of an embedded system, the performance evaluation apparatus comprising:

a scenario selector for obtaining requisite experience information from a database built in advance based on user experience information in using the embedded system, under a predetermined condition for scenario selection, and determining a performance evaluation scenario in consideration of the obtained requisite experience information; and

a performance evaluator for evaluating performance of the embedded system according to the determined performance evaluation scenario.

9. The performance evaluation apparatus of claim 8, wherein the scenario selector is configured to

collect user experience information in driving the embedded system based on a condition arranged or set in advance, and generate a database based on the collected user experience information.

10. The performance evaluation apparatus of claim 8, wherein the scenario selector is configured to

analyze an experience pattern of a user in using the embedded system with the obtained requisite experience information, and design a performance evaluation scenario based on the analyzed experience pattern of the user.

11. The performance evaluation apparatus of claim 10, wherein the scenario selector is configured to

define at least one performance evaluation scenario in advance, each corresponding to one of a plurality of experience patterns;

and select a performance evaluation scenario for selecting performance of the embedded system from among the at least one performance evaluation scenario, each determined in advance to correspond to one of the plurality of experience patterns, according to the analyzed experience pattern of the user.

12. The performance evaluation apparatus of claim 8, wherein the performance evaluator is configured to

run at least one evaluation program in the embedded system according to the determined performance evaluation scenario, and analyze performance of at least one component subject to evaluation, which is involved in running the at least one evaluation program, among components of the embedded system.

13. The performance evaluation apparatus of claim 12, wherein the component subject to evaluation includes at least one of a central processing unit, a graphic processing unit, and a hardware platform, included in the embedded system.

14. The performance evaluation apparatus of claim 8, wherein the experience information includes identification information and location for the embedded system, and information about a type of a program used, a running frequency of each program, a running time of each program, a user'"'"'s gender, age, and weather and wherein the condition for scenario selection is information used as a basis for sorting out the experience information and defined by at least one of the identification information of the embedded system, the user'"'"'s gender, the user'"'"'s age, and location.