Automated perceptual quality assessment of touchscreen devices

• US 9,298,312 B2
• Filed: 02/15/2012
• Issued: 03/29/2016
• Est. Priority Date: 06/30/2011
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Kuznetsov, Eugene
• Primary Examiner(s): SHERMAN, STEPHEN G
• Application Number:
  US13/997,044
• Publication Number:
  US 20150029107A1
• Time in Patent Office: 1,504 Days
• Field of Search: 345173-178, 179 1801- 1809, 179/18.11
• US Class Current: 1/1
• CPC Class Codes: G06F 11/302 where the computing system component is a software system
• CPC Class Codes: G06F 11/3041 where the computing system component is an input/output interface interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units G06F13/00
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3438 monitoring of user actions tracking the activity of the user H04L67/535
• CPC Class Codes: G06F 11/3485 for I/O devices
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 2201/88 Monitoring involving counting
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G09G 3/006 Electronic inspection or testing of displays and display drivers, e.g. of LED or LCD displays testing individual LED's G01R31/2635; testing lamps G01R31/44; testing of optical features of LCD displays G02F1/1309

Abstract

Methods and systems may provide for receiving a video of an interaction with a touch screen, using a computer vision process to identify a gesture in the video, and determining a response time of the touch screen with respect to the gesture. Moreover, a display area update percentage can be tracked subsequent to a response of the touch screen to the gesture, wherein a frame rate determination may be conducted for the touch screen based on the display area update percentage.

Claims

1. A method comprising:

receiving a video of a user interaction with a touch screen;

using a computer vision process to identify a gesture in the video;

detecting a first display update on the touch screen;

determining a response time of the touch screen with respect to the gesture, wherein determining the response time includes counting one or more frames between the gesture and the first display update;

tracking a display area update percentage subsequent to the first display update, wherein the display area update percentage is tracked on a frame-by-frame basis;

conducting a frame rate determination for the touch screen based on the display area percentage update; and

outputting the response time and a result of the frame rate determination.

2. The method of claim 1, further including deferring the frame rate determination if a second display update has occurred on the touch screen.

3. The method of claim 2, further including using a no motion counter and a threshold to trigger the frame rate determination.

4. The method of claim 2, further including detecting the second display update, wherein the first display update and the second display update are detected on a frame-by-frame basis.

5. A computing system comprising:

a non-volatile memory to store a video of a user interaction with a touch screen; and

a chipset including logic to,

receive the video,

use a computer vision process to identify a gesture in the video,

determine a response time of the touch screen with respect to the gesture,

track a display area update percentage subsequent to a response of the touch screen to the gesture,

conduct a frame rate determination for the touch screen based on the display area update percentage, and

output the response time and a result of the frame rate determination.

6. The system of claim 5, wherein the logic is to count one or more frames between the gesture and a first display output on the touch screen.

7. The system of claim 6, wherein the logic is to detect the first display output on a frame-by-frame basis.

8. The system of claim 5, wherein the display area update percentage is to be tracked on a frame-by-frame basis.

9. The system of claim 5, wherein the logic is to defer the frame rate determination if a second display update has occurred on the touch screen.

10. The system of claim 9, wherein the logic is to use a no motion counter and a threshold to trigger the frame rate determination.

11. The system of claim 9, wherein the logic is to detect the second display update on a frame-by-frame basis.

12. A non-transitory computer readable storage medium comprising a set of instructions which, if executed by a processor, cause a computer to:

receive a video of a user interaction with a touch screen;

use a computer vision process to identify a gesture in the video;

determine a response time of the touch screen with respect to the gesture;

track a display area update percentage subsequent to a response of the touch screen to the gesture;

conduct a frame rate determination for the touch screen based on the display area update percentage; and

output the response time and a result of the frame rate determination.

13. The medium of claim 12, wherein the instructions, if executed, cause a computer to count one or more frames between the gesture and a first display update on the touch screen.

14. The medium of claim 13, wherein the instructions, if executed, cause a computer to detect the first display update on a frame-by-frame basis.

15. The medium of claim 12, wherein the display area update percentage is to be tracked on a frame-by-frame basis.

16. The medium of claim 12, wherein the instructions, if executed, cause a computer to defer the frame rate determination if a second display update has occurred on the touch screen.

17. The medium of claim 16, wherein the instructions, if executed, cause a computer to use a no motion counter and a threshold to trigger the frame rate determination.

18. The medium of claim 16, wherein the instructions, if executed, cause a computer to detect the second display update on a frame-by-frame basis.

19. A method comprising:

receiving a video of a user interaction with a touch screen;

using a computer vision process to identify a gesture in the video;

determining a response time of the touch screen with respect to the gesture;

tracking a display area update percentage subsequent to a response of the touch screen to the gesture;

conducting a frame rate determination for the touch screen based on the display area update percentage; and

outputting the response time and a result of the frame rate determination.

20. The method of claim 19, wherein determining the response time includes counting one or more frames between the gesture and a first display update on the touch screen.

21. The method of claim 20, further including detecting the first display update on a frame-by-frame basis.

22. The method of claim 19, wherein the display area update percentage is tracked on a frame-by-frame basis.

23. The method of claim 19, further including deferring the frame rate determination if a second display update has occurred on the touch screen.

24. The method of claim 23, further including using a no motion counter and a threshold to trigger the frame rate determination.

25. The method of claim 23, further including detecting the second display update on a frame-by-frame basis.