Touch prediction for visual displays

• US 10,162,456 B2
• Filed: 06/24/2016
• Issued: 12/25/2018
• Est. Priority Date: 06/04/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Hewitt, Trudy L., McKinney, Debra J., Wetli, Christina L.
• Primary Examiner(s): Faragalla, Michael A
• Assistant Examiner(s): Lu, William
• Application Number:
  US15/191,668
• Publication Number:
  US 20160306493A1
• Time in Patent Office: 914 Days
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06N 5/04 Inference or reasoning models
• CPC Class Codes: G06N 7/01 Probabilistic graphical models, e.g. probabilistic networks
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

Touch events can be predicted relative to a visual display by maintaining a database of aggregated touch event history data relative to the visual display and from a plurality of touch screen devices. The database can be queried according to a set of input parameters defining an environment for use of the visual display. The results from the querying of the database can be analyzed to predict a set of touch events within the environment and based upon inferences obtained from the results. A representation of the set of touch events can be displayed along with the visual display.

Claims

1. A method for predicting touch events relating to a first visual display, the method comprising:

maintaining a database of aggregated touch event history data relative to the first visual display and from a plurality of touch screen devices;

training a machine learning algorithm using data in the database of aggregated touch event history data;

querying the database according to a first set of environmental parameters, wherein the first set of environmental parameters provide information regarding a first environment in which the first visual display is used and comprise a level of professional expertise and a type of professional specialty of the user;

analyzing results from the querying of the database, wherein the results illustrate that there is no direct touch event history for the first set of environmental parameters in the database, and wherein the analyzing comprises applying the machine learning algorithm to the results from the querying of the database;

predicting a set of touch events within the first environment and based upon inferences obtained from the results, wherein the inferences are based on touch event history of a second environment associated with a second set of environmental parameters that is different than the first set and for which there is direct touch event history; and

displaying a representation of the set of touch events on a second visual display.

2. The method of claim 1, further comprising filtering the results based upon a filter request, wherein the filter request comprises eliminating from consideration the touch event history data that do not pertain to an annotation made by a user of the first visual display.

3. The method of claim 1, wherein the aggregated touch event history data includes touch coordinates defined relative to the first visual display and timing data for touch events that are described in the aggregated touch event history data.

4. A system comprising:

a processor; and

a memory in communication with the processor, the memory containing program instructions that, when executed by the processor, are configured to cause the processor to perform a method for predicting touch events relating to a first visual display, the method comprising;

maintaining a database of aggregated touch event history data relative to the first visual display and from a plurality of touch screen devices;

training a machine learning algorithm using data in the database of aggregated touch event history data;

querying the database according to a first set of environmental parameters, wherein the first set of environmental parameters provide information regarding a first environment in which the first visual display is used and comprise a level of professional expertise and a type of professional specialty of the user;

analyzing results from the querying of the database, wherein the results illustrate that there is no direct touch event history for the first set of environmental parameters in the database, and wherein the analyzing comprises applying the machine learning algorithm to the results from the querying of the database;

predicting a set of touch events within the first environment and based upon inferences obtained from the results, wherein the inferences are based on touch event history of a second environment associated with a second set of environmental parameters that is different than the first set and for which there is direct touch event history; and

displaying a representation of the set of touch events on a second visual display.

5. The system of claim 4, further comprising filtering the results based upon a filter request, wherein the filter request comprises eliminating from consideration the touch event history data that do not pertain to an annotation made by a user of the first visual display.

6. The system of claim 4, wherein the aggregated touch event history data includes touch coordinates defined relative to the first visual display and timing data for touch events that are described in the aggregated touch event history data.

7. The system of claim 4, wherein at least one of the environmental parameters in the first set of environmental parameters pertains to a level of medical experience of a user of the first visual display.

8. The system of claim 4, wherein the first visual display is a website and the set of touch events indicate how individuals would be expected to use the website.

9. A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to predict touch events relating to a first visual display, comprising:

maintaining a database of aggregated touch event history data relative to the first visual display and from a plurality of touch screen devices;

training a machine learning algorithm using data in the database of aggregated touch event history data;

querying the database according to a first set of environmental parameters, wherein the first set of environmental parameters provide information regarding a first environment in which the first visual display is used and comprise a level of professional expertise and a type of professional specialty of the user;

analyzing results from the querying of the database, wherein the results illustrate that there is no direct touch event history for the first set of environmental parameters in the database, and wherein the analyzing comprises applying the machine learning algorithm to the results from the querying of the database;

predicting a set of touch events within the first environment and based upon inferences obtained from the results, wherein the inferences are based on touch event history of a second environment associated with a second set of environmental parameters that is different than the first set and for which there is direct touch event history; and

displaying a representation of the set of touch events on a second visual display.

10. The computer program product of claim 9, further comprising filtering the results based upon a filter request, wherein the filter request comprises eliminating from consideration the touch event history data that do not pertain to an annotation made by a user of the first visual display.

11. The computer program product of claim 9, wherein the aggregated touch event history data includes touch coordinates defined relative to the first visual display and timing data for touch events that are described in the aggregated touch event history data.

12. The computer program product of claim 9, wherein displaying a representation of the set of touch events on a second visual display further includes displaying a probability percentage for the set of touch events.