SMART TOUCH LOCATION PREDICTOR BASED ON DIRECTION VECTOR

• US 20170160856A1
• Filed: 12/08/2015
• Published: 06/08/2017
• Est. Priority Date: 12/08/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Pillarisetty, Avinash
• Granted Patent: US 10,365,748 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs

Abstract

A method and electronic device for predicting a touch location. The method includes detecting a hover input over a touchscreen and computing a first point of the hover input that includes first x and y coordinates associated with a surface of the touchscreen and z coordinate first distance. The method further includes detecting a movement of the hover input over the touchscreen and computing a second point associated with the movement of the hover input that includes second x and y coordinates associated with the surface of the touchscreen and a z coordinate second distance. The method includes predicting the touch location that is expected to contact the surface of the touchscreen using a position vector determined based on the first point and the second point. The method may further include dynamically recalibrating the prediction based on newer points observed as and when the hover input hovers over the touchscreen.

Claims

1. A method for predicting a touch location, the method comprising:

detecting, by an electronic device, a hover input over a touchscreen associated with the electronic device;

computing, by the electronic device, a first point of the hover input that includes first x and y coordinates associated with a surface of the touchscreen and a z coordinate that includes a first distance between the hover input and the touchscreen;

detecting, by the electronic device, a movement of the hover input over the touchscreen;

computing, by the electronic device, a second point associated with the movement of the hover input, wherein the second point includes second x and y coordinates associated with the surface of the touchscreen and a z coordinate that includes a second distance between the moved hover input and the touchscreen; and

predicting the touch location that is expected to contact the surface of the touchscreen using a position vector determined based on the first point and the second point, wherein the position vector is calibrated based on a next point that is obtained from further movement of the hover input over the touchscreen.

2. The method of claim 1, wherein computing the first point comprises:

calibrating a threshold of capacitance to sense the hover input; and

estimating the first distance between the hover input and the touchscreen in accordance with the threshold of capacitance that was calibrated.

3. The method of claim 2, wherein the threshold is determined by a capacitance between the touchscreen and the hover input, a distance between the touchscreen and the hover input, or combinations thereof.

4. The method of claim 1, wherein the position vector is obtained in accordance with the following equation:

PQ(t)=<

x1,y1,d1>

+t<

x2−

x1,y2−

y1,d2−

d1>

where x1 is the first x coordinate, y1 is the second y coordinate, d1 is the first distance, x2 is the second x coordinate, y2 is the second y coordinate, d2 is the second distance.

5. The method of claim 1, wherein the touch location that is expected to contact the surface of the touchscreen is obtained in accordance with the following equation:

R=<

x1+d1(x2−

x1)/d1−

d2,y1+d1(y2−

y1)/d1−

d2,0>

where R is a probable point of the touchscreen that is expected to contact the surface of the touchscreen.

6. The method of claim 1, further comprising:

selecting a centroid of a region among multiple sensors to detect the hover input,

wherein computing the first point comprises computing the first point in accordance with the centroid of the region and the first distance; and

wherein computing the second point comprises computing the second point in accordance with the centroid of the region and the second distance.

7. The method of claim 6, wherein the centroid of the region is obtained in accordance with the following equation:

((X^max−

X^min)/2+Xmin,(Y^max−

Y^min)/2+Ymin)

wherein X^max is a maximum number on a grid of a scan line in an X-plane of the touchscreen, X^min is a minimum number on the grid of the scan line in the X-plane, Y^max is a maximum number on the grid of a scan line in the Y-plane of the touchscreen, and Y^min is the minimum number on the grid of the scan line in the Y-plane, and wherein the X^max, X^min, Y^max, and Y^min are obtained in an active region on the touchscreen.

8. The method of claim 7, wherein the active region includes the centroid of the region that is obtained in accordance with a sensor location with a maximum capacitance.

9. The method of claim 2, further comprising:

re-computing the position vector when the electronic device detects the capacitance exceeding the threshold.

10. The method of claim 1, further comprising:

predicting the touch location including at least one probable touch key on the touchscreen that is activated before actual touching event of the touchscreen;

reducing a search space for a next inputting in accordance with the prediction using the position vector to predict a touch location on the touchscreen; and

dynamically resizing the touch location on the touchscreen that is the expected region for the next inputting in accordance with the reduced search space, wherein the touch location is a virtual keyboard on the touchscreen that is enlarged or highlighted.

11. An electronic device comprising:

a touchscreen; and

at least one processor configured to;

detect, via the touchscreen, a hover input over the touchscreen associated with the electronic device; and

detect, via the touchscreen, a movement of the hover input over the touchscreen associated with the electronic device; and

compute a first point of the hover input that includes first x and y coordinates associated with a surface of the touchscreen and z coordinate associated with a first distance between the hover input and the touchscreen;

compute a second point associated with the movement of hover input that includes second x and y coordinates associated with the surface of the touchscreen and z coordinate associated with a second distance between the moved hover input and the touchscreen; and

predict a touch location that is expected to contact the surface of the touchscreen using a position vector determined based on the first point and the second point, wherein the position vector is calibrated based on a next point that is obtained from further movement of the hover input over the touchscreen.

12. The electronic device of claim 11, wherein the electronic device comprises a touch controller and a touch sensor, and wherein the touch location that is expected to contact the surface of the touchscreen using the position vector is determined based on the XY plane of the touchscreen and the point on position vector intersecting the XY plane and a z coordinate having a zero.

13. The electronic device of claim 11, wherein the at least one processor is further configured to:

calibrate a threshold of capacitance to sense the hover input; and

estimate the first distance between the hover input and the touchscreen in accordance with the threshold of capacitance that was calibrated.

14. The electronic device of claim 11, wherein:

the at least one touch controller is further configured to select a centroid of a region among multiple sensors to detect the hover input, and

the at least one processor is further configured to;

compute the first point in accordance with the centroid of the region and the first distance; and

compute the second point in accordance with the centroid of the region and the second distance.

15. The electronic device of claim 11, wherein the at least one processor is configured to:

predict the touch location including at least one probable touch key on the touchscreen that is activated before actual touching event of the touchscreen;

reduce a search space for a next inputting in accordance with the prediction using the position vector to predict a touch location on the touchscreen; and

dynamically resize the touch location on the touchscreen that is the expected region for the next inputting in accordance with the reduced search space, wherein the touch location is a virtual keyboard on the touchscreen that is enlarged or highlighted.

16. A non-transitory computer-readable medium comprising program code, that when executed by at least one processor of an electronic device, causes the electronic device to:

detect a hover input over a touchscreen associated with the electronic device;

compute a first point of the hover input that includes first x and y coordinates associated with a surface of the touchscreen and z coordinate that includes a first distance between the hover input and the touchscreen;

detect a movement of the hover input over the touchscreen;

compute a second point associated with the movement of the hover input, wherein the second point includes second x and y coordinates associated with the surface of the touchscreen and z coordinate that includes a second distance between the moved hover input and the touchscreen; and

predict a touch location that is expected to contact the surface of the touchscreen using a position vector determined based on the first point and the second point.

17. The computer-readable medium of claim 16, wherein the program code that causes the electronic device to calculate the first point comprises program code, that when executed by at least one processor of an electronic device, causes the electronic device to:

calibrate a threshold of capacitance to sense the hover input; and

estimate the first distance between the hover input and the touchscreen in accordance with the threshold of capacitance that was calibrated.

18. The computer-readable medium of claim 17, further comprising program code, that when executed by at least one processor of an electronic device, causes the electronic device to:

re-compute the position vector when the electronic device detects the capacitance exceeding the threshold.

19. The computer-readable medium of claim 16, further comprising program code, that when executed by at least one processor of an electronic device, causes the electronic device to:

select a centroid of a region among multiple sensors to detect the hover input,

wherein the program code that causes the electronic device to calculate the first point comprises program code, that when executed by at least one processor of an electronic device, causes the electronic device to compute the first point in accordance with the centroid of the region and the first distance; and

wherein the program code that causes the electronic device to calculate the second point comprises program code, that when executed by at least one processor of an electronic device, causes the electronic device to compute the second point in accordance with the centroid of the region and the second distance.

20. The computer-readable medium of claim 16, further comprising program code, that when executed by at least one processor of an electronic device, causes the electronic device to:

predict the touch location including at least one probable touch key on the touchscreen that is activated before actual touching event of the touchscreen;

reduce a search space for a next inputting in accordance with the prediction using the position vector to predict a touch location on the touchscreen; and

dynamically resize the touch location on the touchscreen that is the expected region for the next inputting in accordance with the reduced search space, wherein the touch location is a virtual keyboard on the touchscreen that is enlarged or highlighted.