METHOD AND APPARATUS FOR ADDRESSING TOUCH DISCONTINUITIES

• US 20160098185A1
• Filed: 10/01/2014
• Published: 04/07/2016
• Est. Priority Date: 10/01/2014
• Status: Active Grant

• Current Assignee: Qeexo Co. (TDK Corporation)
• Original Assignee: Qeexo Co. (TDK Corporation)
• Inventors: SCHWARZ, JULIA, HARRISON, CHRISTOPHER, XIAO, ROBERT
• Granted Patent: US 10,095,402 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 10/34 Smoothing or thinning of the pattern; Morphological operations; Skeletonisation
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 30/347 Sampling; Contour coding; Stroke extraction

Abstract

Systems and methods are provided that determine when an initial stroke and a subsequent stroke track may be part of a common user input action. A method may include receiving a signal from which an initial stroke track representing an initial movement of a user controlled indicator against a touch sensitive surface and sensing a subsequent stroke track representing subsequent movement of the user controlled indicator against the touch sensitive surface can be determined. The method further includes determining that the initial stroke track and the subsequent stroke track comprise portions of common user input action when the initial stroke track is followed by the subsequent stroke track within a predetermined period of time and a trajectory of the initial stroke track is consistent with a trajectory of the subsequent stroke track.

Claims

1. A system for determining a user input action comprising:

a sensor sensing an initial stroke track representing an initial movement of a user controlled indicator against a touch sensitive surface and sensing a subsequent stroke track representing subsequent movement of the user controlled indicator against the touch sensitive surface; and

a processor receiving the signal and determining that the initial stroke track and the subsequent stroke track comprise portions of common user input action when the initial stroke track is followed by the subsequent stroke track within a continuity time range and a trajectory of the initial stroke track is consistent with a trajectory of the subsequent stroke track.

2. The system of claim 1, wherein the processor determines that the initial stroke track and the subsequent stroke track have trajectories that are consistent with a common user input action when the initial stroke has a velocity that is within 30% of a velocity of the subsequent stroke.

3. The system of claim 1, wherein the processor determines that the initial stroke track and the subsequent stroke track have trajectories that are consistent with a common user input action when the initial stroke track has an initial curvature and the subsequent stroke track has a subsequent curvature with a radius that is within 30% of a radius of initial curvature.

4. The system of claim 1, further comprising a sensor adapted to sense impact between the indicator and a touch sensitive surface, to provide impact data representative of the sensed impact to the processor and wherein the processor further determines that the initial stroke track is not part of a common input action with the subsequent stroke track when the processor determines that here has been an impact at the start of the subsequent stroke track that is consistent with an impact after an intentional lift of the indicator from the touch sensitive surface.

5. The system of claim 1, further comprising a sensor adapted to sense impact between the indicator and a touch sensitive surface, to provide impact data representative of the sensed impact to the processor and wherein the processor further determines that the initial stroke track is not part of a common input action with the subsequent stroke track when the processor determines that here has been an impact at the start of the subsequent stroke.

6. The system of claim 1, wherein the processor determines that trajectory of the initial stroke track is consistent with a trajectory of a subsequent stroke track when an average velocity of the initial stroke track is within 30% of a velocity of the subsequent stroke track.

7. The system of claim 1, wherein the processor determines that trajectory of the initial stroke track is consistent with a trajectory of a subsequent stroke track when an average initial stroke velocity for the last 30% of the initial stroke track that is within 30% of an average subsequent stroke velocity for the first 30% of the subsequent stroke track.

8. The system of claim 1, further comprising a sensor capable of sensing conditions that are indicative of force applied by a stylus against the touch sensitive surface during a stroke wherein the processor further determines that the subsequent stroke track is not part of a common user input action with the initial stroke track when the processor determines that an impact force profile sensed by the force sensor at a start of the subsequent stroke track are consistent is consistent with a force profile of an impact that arises when a user brings an indicator against a touch sensitive surface after an intentional lift.

9. The system of claim 8, wherein the force sensor comprises at least one of a microphone, a sound sensor, a vibration sensor, a piezoelectric sensor, a stress sensor, a strain sensor, a deflection sensor, a compression sensor, and a resiliently biased sensing system that can sense force based on an extent of deflection movement of a contact surface against the force of the resilient member and that can generate a signal that is indicative of the amount of force applied by or through an indicator against touch sensitive surface.

10. The system of claim 8, wherein the force sensor comprises rounded resiliently flexible tip of an indicator that flatten when pressed against touch sensitive surface increasing the amount of surface area in contact with touch sensitive surface as a function of the amount of force applied through the tip and wherein the processor determines an amount of force applied by the indicator against the touch sensitive surface based upon the surface area of the indicator that is in contact with the touch sensitive surface.

11. The system of claim 1, wherein the processor is further adapted to determine a discontinuity velocity based at least in part upon one of an initial stroke velocity of at least a part of the initial stroke track and a subsequent stroke velocity of at least a part of the subsequent stroke track.

12. The system of claim 11, wherein the processor determines an estimated discontinuity stroke length based upon the determined discontinuity velocity and the time between the between a time of an end of the initial stroke track and a time of a start of the subsequent stroke track

13. The system of claim 12, wherein the processor determines a minimum stroke length between an end of the initial stroke track and a start of the subsequent stroke track, and determines that the initial stroke track and the subsequent stroke track are not portions of a common user input action where the minimum stroke length is greater than the estimated discontinuity stroke length.

14. The system of claim 12, wherein each stroke track may be one of a limited number of predetermined stroke patterns, the estimated stroke length can be determined and the processor determines a composite stroke can be generated based upon the number of predetermined stroke patterns that correspond to the initial stroke track and the subsequent stoke track while also providing a path from an end of the initial stroke track to the subsequent stroke track that has a path length that is closest to the estimated discontinuity track length.

15. The system of claim 1, wherein the processor determines an estimated discontinuity stroke length based upon at least one of an acceleration of the initial stroke, an acceleration of the subsequent stroke, a trajectory of the initial stroke and a trajectory of the subsequent stroke.

16. The system of claim 1, wherein the continuity time range is smaller than between about 100 milliseconds and 400 milliseconds.

17. The system of claim 1, wherein a predetermined function is used to calculate the time continuity range dynamically based upon the stroke trajectory.

18. The system of claim 1, wherein the continuity time range is determined based at least in part upon at least one of a velocity of the initial stroke track, a velocity of the subsequent stroke track, an acceleration of the initial stroke track and an acceleration of the subsequent stroke track.

19. The system of claim 1, wherein the continuity time range is determined based upon function in which the continuity time range is at least in part inversely proportional to at least one of a velocity of the initial stroke track, a velocity of the subsequent stroke track, an acceleration of the initial stroke track, an acceleration of the subsequent stroke track, a trajectory of the initial stroke track and a trajectory of the subsequent stroke track.

20. The system of claim 1, wherein the trajectory of the initial stroke track is determined to be consistent with a trajectory of a subsequent stroke track when an average initial stroke acceleration for the last 30% of the initial stroke track is within 30% of an average subsequent stroke acceleration for the first 30% of the subsequent stroke track.

21. The system of claim 1, wherein when it is determined that the initial stroke track and the subsequent stroke track comprise portions of common user input action, a discontinuity stroke track is determined based upon a direction and magnitude of a velocity of the initial stroke track, a direction and magnitude of an acceleration of the initial stroke track, a direction and magnitude of a velocity of the subsequent stroke track and direction and magnitude of an acceleration of the subsequent stroke track.

22. The system of claim 1, wherein when it is determined that the initial stroke track and the subsequent stroke track comprise portions of common user input action, a discontinuity stroke track is determined by extending forward projection from an end of the initial stroke track and wherein the forward projection follows a trajectory that is determined based upon at least one of a direction and magnitude of a velocity of the initial stroke track, and a direction and magnitude of an acceleration of the initial stroke track.

23. The system of claim 1, wherein when it is determined that the initial stroke track and the subsequent stroke track comprise portions of common user input action, a discontinuity stroke track is determined by extending a rearward from a start of the subsequent stroke track and wherein the rearward projection follows a trajectory that is determined based upon at least one of a direction and magnitude of a velocity of the subsequent stroke track, and a direction and magnitude of an acceleration of the subsequent stroke track.

24. A continuity determination method comprising the steps of:

receiving a signal from which an initial stroke track representing an initial movement of a user controlled indicator against a touch sensitive surface and sensing a subsequent stroke track representing subsequent movement of the user controlled indicator against the touch sensitive surface can be determined; and

determining that the initial stroke track and the subsequent stroke track comprise portions of common user input action when the initial stroke track is followed by the subsequent stroke track within a predetermined period of time and a trajectory of the initial stroke track is consistent with a trajectory of the subsequent stroke track.

25. The method of claim 24, wherein the initial stroke track and the subsequent stroke track are determined to have trajectories that are consistent with a common user input action when the initial stroke track has a velocity that is within 30% of a velocity of the subsequent stroke track.

26. The method of claim 24, wherein the initial stroke track and the subsequent stroke track are determined to have trajectories that are consistent with a common user input action when the initial stroke track has an initial curvature and the subsequent stroke track has a subsequent curvature with a radius that is within 30% of a radius of initial curvature.

27. The method of claim 24, further comprising sensing an impact force profile at an impact between the indicator and a touch sensitive surface and determining that the initial stroke track is not part of a common input action with the subsequent stroke track when there has been an impact at the start of the subsequent stroke track that is consistent with an impact after an intentional lift of the indicator from the touch sensitive surface.

28. The method of claim 24, further comprising sensing a force profile between the indicator and a touch sensitive surface during the subsequent stroke track and determining that the initial stroke track is not part of a common input action with the subsequent stroke track there is an impact force profile at the start of the subsequent stroke track that is consistent with an impact that occurs after an intentional lift of the indicator from contact with the touch sensitive surface.

29. The method of claim 24, wherein the trajectory of the initial stroke track is consistent with a trajectory of a subsequent stroke track when an average velocity of the initial stroke is within 30% of a velocity of the subsequent stroke.

30. The method of claim 24, wherein the trajectory of the initial stroke track is determined to be consistent with a trajectory of a subsequent stroke track when an average initial stroke velocity for the last 30% of the initial stroke track is within 30% of an average subsequent stroke velocity for the first 30% of the subsequent stroke track.

31. The method of claim 24, wherein the trajectory of the initial stroke track is determined to be consistent with a trajectory of a subsequent stroke track when an average initial stroke acceleration for the last 30% of the initial stroke track is within 30% of an average subsequent stroke acceleration for the first 30% of the subsequent stroke track.

32. The method of claim 24, wherein when it is determined that the initial stroke track and the subsequent stroke track comprise portions of common user input action, a discontinuity stroke track is determined based upon a direction and magnitude of a velocity of the initial stroke track, a direction and magnitude of an acceleration of the initial stroke track, a direction and magnitude of a velocity of the subsequent stroke track and direction and magnitude of an acceleration of the subsequent stroke track.

33. The method of claim 24, wherein when it is determined that the initial stroke track and the subsequent stroke track comprise portions of common user input action, a discontinuity stroke track is determined by extending forward projection from an end of the initial stroke track and wherein the forward projection follows a trajectory that is determined based upon at least one of a direction and magnitude of a velocity of the initial stroke track, and a direction and magnitude of an acceleration of the initial stroke track.

34. The method of claim 24, wherein when it is determined that the initial stroke track and the subsequent stroke track comprise portions of common user input action, a discontinuity stroke track is determined by extending a rearward from a start of the subsequent stroke track and wherein the rearward projection follows a trajectory that is determined based upon at least one of a direction and magnitude of a velocity of the subsequent stroke track, and a direction and magnitude of an acceleration of the subsequent stroke track.

35. A computer-readable recording medium having program instructions that can be executed by various computer components to perform a method comprising:

receiving a signal from which an initial stroke track representing an initial movement of a user controlled indicator against a touch sensitive surface and sensing a subsequent stroke track representing subsequent movement of the user controlled indicator against the touch sensitive surface can be determined, and;

determining that the initial stroke track and the subsequent stroke track comprise portions of common user input action when the initial stroke track is followed by the subsequent stroke track within a predetermined period of time and a trajectory of the initial stroke track is consistent with a trajectory of the subsequent stroke track.