Smart touch location predictor based on direction vector

• US 10,365,748 B2
• Filed: 12/08/2015
• Issued: 07/30/2019
• Est. Priority Date: 12/08/2015
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Pillarisetty, Avinash
• Primary Examiner(s): McLoone, Peter D
• Application Number:
  US14/963,033
• Publication Number:
  US 20170160856A1
• Time in Patent Office: 1,330 Days
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/04186 Touch location disambiguation
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs

Abstract

A method and electronic device for predicting a touch location. The method includes detecting a hover input over a touchscreen and computing a first point of the hover input that includes first x and y coordinates associated with a surface of the touchscreen and z coordinate first distance. The method further includes detecting a movement of the hover input over the touchscreen and computing a second point associated with the movement of the hover input that includes second x and y coordinates associated with the surface of the touchscreen and a z coordinate second distance. The method includes predicting the touch location that is expected to contact the surface of the touchscreen using a position vector determined based on the first point and the second point. The method may further include dynamically recalibrating the prediction based on newer points observed as and when the hover input hovers over the touchscreen.

Claims

1. A method for predicting a touch location, the method comprising:

detecting, by an electronic device, a hover input over a touchscreen associated with the electronic device;

in response to detecting the hover input, selecting a region associated with the hover input, the region determined by a maximum number and a minimum number on a grid of scan lines for each dimension of a coordinate plane of the touchscreen;

computing, by the electronic device, a first point of the hover input that includes first x and y coordinates associated with a surface of the touchscreen and a z coordinate that includes a first distance between the hover input and the touchscreen;

detecting, by the electronic device, a movement of the hover input over the touchscreen;

computing, by the electronic device, a second point associated with the movement of the hover input, wherein the second point includes second x and y coordinates associated with the surface of the touchscreen and a z coordinate that includes a second distance between the moved hover input and the touchscreen; and

predicting the touch location that is expected to contact the surface of the touchscreen using a position vector determined based on the first point and the second point, wherein the position vector is calibrated based on a next point that is obtained from further movement of the hover input over the touchscreen.

2. The method of claim 1, wherein computing the first point comprises:

calibrating a threshold of capacitance to sense the hover input; and

estimating the first distance between the hover input and the touchscreen in accordance with the threshold of capacitance that was calibrated.

3. The method of claim 2, wherein the threshold of capacitance is determined by a capacitance between the touchscreen and the hover input, a distance between the touchscreen and the hover input, or combinations thereof.

4. The method of claim 2, further comprising re-computing the position vector when the electronic device detects a capacitance exceeding the threshold of capacitance.

5. The method of claim 1, wherein the position vector is given by:

PQ(t)=<

x1,y1,d1>

+t<

x2−

x1,y2−

y1,d2−

d1>

where x1 is a first x coordinate, y1 is a first y coordinate, d1 is a first distance, x2 is a second x coordinate, y2 is a second y coordinate, d2 is a second distance, and t is a time.

6. The method of claim 1, wherein the touch location that is expected to contact the surface of the touchscreen is given by:

R=<

x1+d1(x2−

x1)/(d1−

d2), y1+d1(y2−

y1)/(d1−

d2), 0>

where R is a probable point of the touchscreen that is expected to contact the surface of the touchscreen, where x1 is a first x coordinate, y1 is a first y coordinate, d1 is a first distance, x2 is a second x coordinate, y2 is a second y coordinate, d2 is a second distance.

7. The method of claim 1, wherein computing the first point comprises computing the first point in accordance with a centroid of the region and the first distance, and

wherein computing the second point comprises computing the second point in accordance with the centroid of the region and the second distance.

8. The method of claim 1, wherein a centroid of the region is given by:

(X^max−

X^min)/2+Xmin, (Y^max−

Y^min)/2+Ymin

where X^max is a maximum number on the grid of scan lines in an X-plane of the touchscreen, X^min is a minimum number on the grid of scan lines in the X-plane, Y^max is a maximum number on the grid of scan lines in a Y-plane of the touchscreen, and Y^min is the minimum number on the grid of scan lines in the Y-plane, and wherein the X^max , X^min , Y^max , and Y^min are obtained in an active region on the touchscreen.

9. The method of claim 8, wherein the active region includes the centroid of the region that is obtained in accordance with a sensor location with a maximum capacitance.

10. The method of claim 1, further comprising:

predicting the touch location including at least one probable touch key on the touchscreen that is activated before actual touching event of the touchscreen;

reducing a search space for a next inputting in accordance with the prediction using the position vector to predict a touch location on the touchscreen; and

dynamically resizing the touch location on the touchscreen that is an expected touch location for the next inputting in accordance with the reduced search space, wherein the touch location is a virtual keyboard on the touchscreen that is enlarged or highlighted.

11. An electronic device comprising:

a touchscreen; and

at least one processor configured to;

detect, via the touchscreen, a hover input over the touchscreen associated with the electronic device;

in response to detecting the hover input, select a region associated with the hover input, the region determined by a maximum number and a minimum number on a grid of scan lines for each dimension of a coordinate plane of the touchscreen;

detect, via the touchscreen, a movement of the hover input over the touchscreen associated with the electronic device;

compute a first point of the hover input that includes first x and y coordinates associated with a surface of the touchscreen and z coordinate associated with a first distance between the hover input and the touchscreen;

compute a second point associated with the movement of the hover input that includes second x and y coordinates associated with the surface of the touchscreen and z coordinate associated with a second distance between the moved hover input and the touchscreen; and

predict a touch location that is expected to contact the surface of the touchscreen using a position vector determined based on the first point and the second point, wherein the position vector is calibrated based on a next point that is obtained from further movement of the hover input over the touchscreen.

12. The electronic device of claim 11, wherein the electronic device comprises a touch controller and a touch sensor, and wherein the touch location that is expected to contact the surface of the touchscreen using the position vector is determined based on an XY plane of the touchscreen and a point on position vector intersecting the XY plane and a z coordinate having a zero.

13. The electronic device of claim 11, wherein the at least one processor is further configured to:

calibrate a threshold of capacitance to sense the hover input; and

estimate the first distance between the hover input and the touchscreen in accordance with the threshold of capacitance that was calibrated.

14. The electronic device of claim 11, wherein the at least one processor is further configured to:

compute the first point in accordance with a centroid of the region and the first distance; and

compute the second point in accordance with the centroid of the region and the second distance.

15. The electronic device of claim 11, wherein the at least one processor is configured to:

predict the touch location including at least one probable touch key on the touchscreen that is activated before actual touching event of the touchscreen;

reduce a search space for a next inputting in accordance with a result of the prediction using the position vector to predict a touch location on the touchscreen; and

dynamically resize the touch location on the touchscreen that is an expected touch location for the next inputting in accordance with the reduced search space, wherein the touch location is a virtual keyboard on the touchscreen that is enlarged or highlighted.

16. A non-transitory computer-readable medium comprising program code, that when executed by at least one processor of an electronic device, causes the electronic device to:

detect a hover input over a touchscreen associated with the electronic device;

in response to detecting the hover input, select a region associated with the hover input, the region determined by a maximum number and a minimum number on a grid of scan lines for each dimension of a coordinate plane of the touchscreen;

compute a first point of the hover input that includes first x and y coordinates associated with a surface of the touchscreen and z coordinate that includes a first distance between the hover input and the touchscreen;

detect a movement of the hover input over the touchscreen;

compute a second point associated with the movement of the hover input, wherein the second point includes second x and y coordinates associated with the surface of the touchscreen and z coordinate that includes a second distance between the moved hover input and the touchscreen; and

predict a touch location that is expected to contact the surface of the touchscreen using a position vector determined based on the first point and the second point.

17. The non-transitory computer-readable medium of claim 16, wherein the program code that causes the electronic device to calculate the first point comprises program code, that when executed by at least one processor of an electronic device, causes the electronic device to:

calibrate a threshold of capacitance to sense the hover input; and

estimate the first distance between the hover input and the touchscreen in accordance with the threshold of capacitance that was calibrated.

18. The non-transitory computer-readable medium of claim 17, further comprising program code, that when executed by at least one processor of an electronic device, causes the electronic device to re-compute the position vector when the electronic device detects a capacitance exceeding the threshold of capacitance.

19. The non-transitory computer-readable medium of claim 16, further comprising program code, that when executed by at least one processor of an electronic device, wherein the program code that causes the electronic device to calculate the first point comprises program code, that when executed by at least one processor of an electronic device, causes the electronic device to compute the first point in accordance with a centroid of the region and the first distance;

and

wherein the program code that causes the electronic device to calculate the second point comprises program code, that when executed by at least one processor of an electronic device, causes the electronic device to compute the second point in accordance with the centroid of the region and the second distance.

20. The non-transitory computer-readable medium of claim 16, further comprising program code, that when executed by at least one processor of an electronic device, causes the electronic device to:

predict the touch location including at least one probable touch key on the touchscreen that is activated before actual touching event of the touchscreen;

reduce a search space for a next inputting in accordance with a result of the prediction using the position vector to predict a touch location on the touchscreen; and

dynamically resize the touch location on the touchscreen that is the expected touch location for the next inputting in accordance with the reduced search space, wherein the touch location is a virtual keyboard on the touchscreen that is enlarged or highlighted.