Measuring device user experience through display outputs

• US 8,823,794 B2
• Filed: 06/30/2011
• Issued: 09/02/2014
• Est. Priority Date: 06/30/2011
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Waring, Damon R., Kao, Keith L., Kwok, Albert
• Primary Examiner(s): Ustaris, Joseph
• Assistant Examiner(s): NAWAZ, TALHA M
• Application Number:
  US13/174,052
• Publication Number:
  US 20130002862A1
• Time in Patent Office: 1,160 Days
• Field of Search: 348 30-161
• US Class Current: 348/143
• CPC Class Codes: G02F 1/1309 Repairing; Testing
• CPC Class Codes: G11B 31/00 Arrangements for the associated working of recording or reproducing apparatus with related apparatus with cameras or projectors G03B31/00 ; recording/reproducing of music for electrophonic musical instruments G10H1/0033; automatic arrangements for answering calls or for recording messages for absent subscribers H04M1/64; telephonic communication systems adapted for combination with dictation recording and playback systems H04M11/10; connection of TV recorder with other related apparatus, e.g. TV camera or receiver, in which the TV signal is significantly involved H04N, e.g. H04N23/00, H04N5/765; combination of radio or TV with other apparatus, e.g. with vehicles H05K11/00
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Methods and systems may include high speed camera to capture a video of a display output, a robotic arm to interact with a device, a processor, and a computer readable storage medium having a set of instructions. If executed by the processor, the instructions cause the system to identify one or more user experience characteristics based on the captured video, and generate a report based on the one or more user experience characteristics. The report may include a perceptional model score that is generated based on the user experience characteristics as well as other parameters. The user experience characteristics could include response time, frame rate and run time characteristics.

Claims

1. A system comprising:

a camera to capture a video of a display output of a device;

a processor; and

a computer readable storage medium including a set of instructions which if executed by the processor, cause the system to,

identify one or more user experience characteristics based on the video, wherein the user experience characteristics reflect and/or measure operation of the device from a perspective of the user;

generate a report based on the one or more user experience characteristics; and

compare chronological data to the one or more user experience characteristics of the video to generate a perceptual model score, wherein the perceptual model score is a rating that is a function of characteristics extracted from the captured video including one or more of;

smoothness, responsiveness, temporal and spatial alignment, display resolution, display settings, content quality, display quality, elapsed time, ease of connectivity, ease of use, thermal comfort, audio/video sync, and audio quality.

2. The system of claim 1, wherein the instructions, if executed, cause the system to identify at least one of a response time characteristic, a frame rate characteristic, a run time characteristic and a quality characteristic.

3. The system of claim 2, further including a robotic arm, wherein the instructions, if executed, cause the system to:

instruct the robotic arm to mimic a user interaction and

identify the response time characteristic with respect to the user interaction.

4. The system of claim 3, wherein the user interaction is to include at least one of a touch screen operation, a mouse operation, a touchpad operation, a keypad operation, a keyboard operation and a microphone operation.

5. The system of claim 3, wherein the user interaction is to include a touch interaction.

6. A method comprising:

a camera to capture a video of a display output of a device;

identifying one or more user experience characteristics based on the video, wherein the user experience characteristics reflect and/or measure operation of the device from a perspective of the user;

generating a report based on the one or more user experience characteristics; and

generating a perceptual model score by comparing chronological data to the one or more user experience characteristics of the video, wherein the perceptual model score is a rating that is a function of characteristics extracted from the captured video including one or more of;

smoothness, responsiveness, temporal and spatial alignment, display resolution, display settings, content quality, display quality, elapsed time, ease of connectivity, ease of use, thermal comfort, audio/video sync, and audio quality.

7. The method of claim 6, wherein identifying the one or more user experience characteristics includes identifying at least one of a response time characteristic, a frame rate characteristic, a run time characteristic and a quality characteristic.

8. The method of claim 7, wherein the response time characteristic is identified with respect to a user interaction.

9. The method of claim 8, wherein the user interaction includes a touch interaction.

10. The method of claim 8, wherein the user interaction includes at least one of a zoom operation, a tap operation, a rotate operation and a pan operation.

11. A non-transitory computer readable storage medium comprising a set of instructions which if executed by the processor, cause a computer to:

identify one or more user experience characteristics based on a video of a display output of a device, wherein the user experience characteristics reflect and/or measure operation of the device from a perspective of the user;

generate a report based on the one or more user experience characteristics; and

compare chronological data to the one or more user experience characteristics of the video to generate a perceptual model score, wherein the perceptual model score is a rating that is a function of characteristics extracted from the captured video including one or more of;

smoothness, responsiveness, temporal and spatial alignment, display resolution, display settings, content quality, display quality, elapsed time, ease of connectivity, ease of use, thermal comfort, audio/video sync, and audio quality.

12. The medium of claim 11, wherein the instructions, if executed, cause a computer to identify at least one of a response time characteristic, a frame rate characteristic, a run time characteristic and a quality characteristic.

13. The medium of claim 12, wherein the instructions, if executed, cause a computer to identify the response time characteristic with respect to a user interaction.

14. The medium of claim 13, wherein the user interaction is to include at least one of a touch screen operation, a mouse operation, a touchpad operation, a keypad operation, a keyboard operation, a microphone operation, and a touch interaction.