Touchscreen keyboard simulation for performance evaluation

• US 8,436,829 B1
• Filed: 09/14/2012
• Issued: 05/07/2013
• Est. Priority Date: 01/31/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Zhai, Shumin, Azenkot, Shiri
• Primary Examiner(s): Eisen, Alexander
• Assistant Examiner(s): MARINELLI, PATRICK
• Application Number:
  US13/618,773
• Time in Patent Office: 235 Days
• Field of Search: 345156-184, 345/104, 715/773, 703 13- 28, 178 1801- 2004
• US Class Current: 345/173
• CPC Class Codes: G06F 11/3414 Workload generation, e.g. scripts, playback
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A computerized system sends a series of touchscreen keyboard touch data to a touchscreen keyboard device that receives the touchscreen keyboard touch data and processes the received string of touchscreen keyboard touch data to simulate touches to a touchscreen of the touchscreen keyboard device. A touchscreen keyboard algorithm is applied to the simulated touches, producing a corrected text string. The effectiveness of the touchscreen keyboard algorithm at producing a correct text string can then be evaluated.

Claims

1. A method, comprising:

receiving, in a first computing device, a series of touchscreen keyboard touch data from a touchscreen keyboard device, wherein the series of touchscreen keyboard touch data represents touches at the touchscreen keyboard device, and wherein the first computing device and the touchscreen keyboard device are separate and distinct devices;

storing the series of touchscreen keyboard touch data at the first computing device, wherein the stored series of touchscreen touch data are later sent to the touchscreen keyboard device as a series of touchscreen keyboard simulated touch data;

sending, from the first computing device, a series of touchscreen keyboard touch data to a touchscreen keyboard device to simulate touches on the touchscreen keyboard device;

receiving, in the first computing device, a text string resulting from the touchscreen keyboard device applying a touchscreen keyboard algorithm to the series of touchscreen keyboard simulated touch data; and

evaluating, in the first computing device, the received text string for accuracy to determine an effectiveness of the applied touchscreen keyboard algorithm.

2. The method of claim 1, wherein sending the series of touchscreen keyboard simulated touch data to the touchscreen keyboard device comprises sending the series of touchscreen keyboard simulated touch data to be received by an application executing on the touchscreen keyboard device.

3. The method of claim 1, further comprising adding a randomized component to position data comprising a part of the series of touchscreen keyboard simulated touch data.

4. The method of claim 1, wherein sending the series of touchscreen keyboard simulated touch data comprises sending the data to a plurality of touchscreen keyboard devices.

5. A method, comprising:

receiving, in a first computing device, a series of touchscreen keyboard touch data from a touchscreen keyboard device, wherein the series of touchscreen keyboard touch data represents touches at the touchscreen keyboard device, wherein the first computing device and the touchscreen keyboard device are separate and distinct devices;

storing the series of touchscreen keyboard touch data at the first computing device, wherein the stored series of touchscreen touch data are later sent to the touchscreen keyboard device as a string of touchscreen keyboard simulated touch data;

receiving, in the touchscreen keyboard device, a string of touchscreen keyboard simulated touch data, and

processing the received string of touchscreen keyboard simulated touch data to simulate touches at a touchscreen of the touchscreen keyboard device;

applying a touchscreen keyboard algorithm to the string of touchscreen keyboard simulated touch data; and

receiving, in the first computing device, a text string resulting from applying the touchscreen keyboard algorithm to the string of touchscreen keyboard simulated touch data, wherein the first computing device evaluates the received text string for accuracy to determine the effectiveness of the applied touchscreen keyboard algorithm.

6. The method of claim 5, wherein receiving the string of touchscreen keyboard simulated touch data comprises receiving the string of touchscreen keyboard simulated touch data in an application or driver running on the touchscreen keyboard device.

7. The method of claim 5, wherein the touchscreen keyboard algorithm is configured to correct at least one of spelling, capitalization, and punctuation.

8. The method of claim 7, further comprising storing the text string resulting from application of the touchscreen keyboard algorithm to the string of touchscreen keyboard simulated touch data.

9. The method of claim 5, wherein the touchscreen keyboard device comprises at least one of a tablet, a smart phone, a television, or an appliance.

10. A computerized system, comprising:

an interface operable to receive a series of touchscreen keyboard touches from a touchscreen keyboard device representing touches on the touchscreen keyboard device, wherein the interface of the computerized system and the touchscreen keyboard device are separate and distinct from each other;

a storage device operable to store the series of touchscreen keyboard touches such that the stored series of touchscreen touches can later be sent to the touchscreen keyboard device as a series of touchscreen keyboard simulated touch data; and

a processor;

wherein the interface is operable to send the series of touchscreen keyboard simulated touch data to the touchscreen keyboard device such that the sent series of touchscreen keyboard simulated touch data is used to simulate the series of touchscreen keyboard touches on the touchscreen keyboard device;

wherein the interface is operable to receive a text string resulting from applying, by the touchscreen keyboard device, a touchscreen keyboard algorithm to the series of touchscreen keyboard simulated touch data; and

wherein the processor is operable to evaluate the received text string for accuracy to determine the effectiveness of the applied touchscreen keyboard algorithm.

11. The computerized system of claim 10, wherein the sent series of touchscreen keyboard simulated touch data is sent to an application executing on the touchscreen keyboard device.

12. The computerized system of claim 10, wherein the processor is operable to add a randomized component to position data comprising a part of the series of touchscreen keyboard touch data.

13. The computerized system of claim 10, further comprising a plurality of touchscreen keyboard devices, wherein the interface is operable to send the series of touchscreen keyboard simulated touch data to the plurality of touchscreen keyboard devices.

14. A touchscreen keyboard device, comprising:

an interface operable to send a series of touchscreen keyboard touches, representing touches at a touchscreen keyboard device, from the touchscreen keyboard device to a first computing device that stores the series of touchscreen keyboard touches, wherein the stored series of touchscreen touches can later be sent to the touchscreen keyboard device as a string of touchscreen keyboard simulated touch data, and wherein the interface is operable receive the string of touchscreen keyboard simulated touch data; and

a processor operable to process the received string of touchscreen keyboard touch data to simulate touches at the touchscreen keyboard device and apply a touchscreen keyboard algorithm to the string of touchscreen keyboard simulated touch data;

wherein the first computing device receives a text string resulting from applying the touchscreen keyboard algorithm to the string of touchscreen keyboard simulated touch data in order to evaluate the received text string for accuracy to determine the effectiveness of the applied touchscreen keyboard algorithm;

wherein the interface of the touchscreen keyboard device and the first computing device are separate and distinct from each other.

15. The touchscreen keyboard device of claim 14, wherein the processor is operable to receive the string of touchscreen keyboard simulated touch data in an application or driver executed by the processor.

16. The touchscreen keyboard device of claim 14, wherein the touchscreen keyboard algorithm is configured to correct at least one of spelling, capitalization, and punctuation.

17. The touchscreen keyboard device of claim 14, wherein the touchscreen keyboard device comprises at least one of a tablet, a smart phone, a television, or an appliance.