TOUCH PREDICTION FOR VISUAL DISPLAYS

• US 20160306493A1
• Filed: 06/24/2016
• Published: 10/20/2016
• Est. Priority Date: 06/04/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hewitt, Trudy L., McKinney, Debra J., Wetli, Christina L.
• Granted Patent: US 10,162,456 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

Touch events can be predicted relative to a visual display by maintaining a database of aggregated touch event history data relative to the visual display and from a plurality of touch screen devices. The database can be queried according to a set of input parameters defining an environment for use of the visual display. The results from the querying of the database can be analyzed to predict a set of touch events within the environment and based upon inferences obtained from the results. A representation of the set of touch events can be displayed along with the visual display.

Claims

1. A method for predicting touch events relating to a first visual display, the method comprising:

maintaining a database of aggregated touch event history data relative to the first visual display and from a plurality of touch screen devices;

querying the database according to a set of environmental parameters, wherein the set of environmental parameters provide information regarding an environment in which the first visual display is used;

analyzing results from the querying of the database to predict a set of touch events within the environment and based upon inferences obtained from the results; and

displaying a representation of the set of touch events on a second visual display.

2. The method of claim 1, further comprising:

filtering the results based upon a filter request, wherein the filter request comprises eliminating from consideration the results that do not comport with at least one environmental parameter selected from the set of environmental parameters;

analyzing the filtered results to predict another set of touch events based upon inferences obtained from the filtered results; and

displaying a representation of the another set of touch events on the second visual display.

3. The method of claim 2, wherein the filtering the results eliminates from consideration the touch event history data that do not pertain to an annotation made by a user of the first visual display.

4. The method of claim 1, wherein the aggregated touch event history data includes touch coordinates defined relative to the first visual display and timing data for touch events that are described in the aggregated touch event history data.

5. The method of claim 1, further comprising training a machine learning algorithm using data in the database of aggregated touch event history data.

6. The method of claim 5, wherein analyzing results from the querying of the database to predict a set of touch events corresponding to the environmental parameters and based upon inferences obtained from the results includes applying the machine learning algorithm to the results from the querying of the database.

7. A system comprising:

a processor; and

a memory in communication with the processor, the memory containing program instructions that, when executed by the processor, are configured to cause the processor to perform a method for predicting touch events relating to a first visual display, the method comprising;

maintaining a database of aggregated touch event history data relative to the first visual display and from a plurality of touch screen devices;

querying the database according to a set of environmental parameters, wherein the set of environmental parameters provide information regarding an environment in which the first visual display is used;

analyzing results from the querying of the database to predict a set of touch events within the environment and based upon inferences obtained from the results; and

displaying a representation of the set of touch events on a second visual display.

8. The system of claim 7, wherein the method further comprises:

filtering the results based upon a filter request, wherein the filter request comprises eliminating from consideration the results that do not comport with at least one environmental parameter selected from the set of environmental parameters;

analyzing the filtered results to predict another set of touch events based upon inferences obtained from the filtered results; and

displaying a representation of the another set of touch events on the second visual display.

9. The system of claim 7, wherein the filtering the results eliminates from consideration the touch event history data that do not pertain to an annotation made by a user of the first visual display.

10. The system of claim 7, wherein the aggregated touch event history data includes touch coordinates defined relative to the first visual display and timing data for touch events that are described in the aggregated touch event history data.

11. The system of claim 7, wherein the method further comprises training a machine learning algorithm using data in the database of aggregated touch event history data.

12. The system of claim 7, wherein at least one of the environmental parameters in the set of environmental parameters pertains to a level of medical experience of a user of the first visual display.

13. The system of claim 7, wherein the first visual display is a website and the set of touch events indicate how individuals would be expected to use the website.

14. A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to predict touch events relating to a first visual display, comprising:

maintaining a database of aggregated touch event history data relative to the first visual display and from a plurality of touch screen devices;

querying the database according to a set of environmental parameters, wherein the set of environmental parameters provide information regarding an environment in which the first visual display is used;

analyzing results from the querying of the database to predict a set of touch events within the environment and based upon inferences obtained from the results; and

displaying a representation of the set of touch events on a second visual display.

15. The computer program product of claim 14, wherein the program instructions further cause the computer to:

filter the results based upon a filter request, wherein the filter request comprises eliminating from consideration the results that do not comport with at least one environmental parameter selected from the set of environmental parameters;

analyze the filtered results to predict another set of touch events based upon inferences obtained from the filtered results; and

display a representation of the another set of touch events on the second visual display.

16. The computer program product of claim 14, wherein the filtering the results eliminates from consideration the touch event history data that do not pertain to an annotation made by a user of the first visual display.

17. The computer program product of claim 14, wherein the aggregated touch event history data includes touch coordinates defined relative to the first visual display and timing data for touch events that are described in the aggregated touch event history data.

18. The computer program product of claim 14, wherein the program instructions further cause the computer to train a machine learning algorithm using data in the database of aggregated touch event history data.

19. The computer program product of claim 14, wherein analyzing results from the querying of the database to predict a set of touch events corresponding to the environmental parameters and based upon inferences obtained from the results includes applying the machine learning algorithm to the results from the querying of the database.

20. The computer program product of claim 14, wherein displaying a representation of the set of touch events on a second visual display further includes displaying a probability percentage for the set of touch events.