Adjusting coordinates of touch input

• US 9,557,781 B2
• Filed: 01/05/2012
• Issued: 01/31/2017
• Est. Priority Date: 01/05/2012
• Status: Expired due to Fees

• Current Assignee: Sony Mobile Communications Incorporated (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Mobile Communications Incorporated (Sony Group Corp.)
• Inventors: Andersson, Henric
• Primary Examiner(s): Patel, Kumar
• Assistant Examiner(s): Lam, Vinh
• Application Number:
  US13/823,860
• Publication Number:
  US 20160011719A1
• Time in Patent Office: 1,853 Days
• Field of Search: 345173-178
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A device may include a touch sensor for determining portions of a touchscreen display that receive touch inputs, and a motion sensor for identifying device motions of the device. Additionally, the device may include a processor to identify coordinates of a portion of the touchscreen display that receives a touch input, identify an input instant at which the touchscreen display receives the touch input, and determine a change of device motion that affects an accuracy of the coordinates of the touch input based on the input instant. In addition, the processor may adjust the coordinates based on the determined change of device motion.

Claims

1. A device comprising:

a touch sensor for determining portions, of a touchscreen display, that receive touch inputs;

a motion sensor for identifying device motions of the device; and

a processor to;

identify coordinates of a portion, of the touchscreen display, that receives a touch input;

identify an input instant, wherein the input instant is an instant at which the touchscreen display receives the touch input;

determine device motion, including angular acceleration, velocity and orientation, during a input motion interval ending at the input instant and having a predetermined duration that is an estimated user response time, the device motion affects an accuracy of the coordinates of the touch input;

determine a positional vector that is a two dimensional representation of the device motion in a plane of the touch screen taken from components of the device motion; and

adjust the coordinates with a compensation motion vector that is equal in magnitude and opposite in direction to the positional vector.

2. The device of claim 1, wherein the processor is further configured to:

associate the adjusted coordinates with a graphical user interface (GUI) object located at the adjusted coordinates at the input instant.

3. The device of claim 1, wherein the processor is further configured to:

determine an output associated with the touch input based on the adjusted coordinates, and further adjust the output using a secondary predictive process.

4. The device of claim 1, wherein, when determining the change in device motion, the processor is further to:

receive a plurality of device motion values over the input motion interval; and

determine the device motion based on the plurality of device motion values.

5. The device of claim 4, wherein, when identifying the input motion interval, the processor is further configured to:

provide a simulated touch input test that includes a configuration of graphical user interface (GUI) objects displayed on the touchscreen display and that move relative to the touchscreen display to simulate device motion; and

determine the input motion interval based on the simulated touch input test.

6. The device of claim 5, wherein, when determining the input motion interval based on the simulated touch input test, the processor is further configured to:

identify an expected touch input at an expected touch location;

receive a test touch input at a test touch location;

identify a simulated device motion associated with the test touch input;

determine a distance between the test touch location and the expected touch location; and

determine the input motion interval based on the simulated device motion and the distance between the test touch location and the expected touch location.

7. The device of claim 1, wherein the device includes:

a cell phone, a tablet, an electronic notepad, a gaming console, a laptop computer, a personal digital assistant, or a personal computer.

8. The device of claim 1, wherein the processor is further configured to:

determine the orientation based on one or more of a yaw, pitch, or roll of the device in a multi-coordinate system.

9. The device of claim 1, wherein the processor is further configured to:

provide the adjusted coordinates as an input for a primary application, wherein the primary application includes one of an email program, a texting program, a web browser, and a gaming application.

10. A computer-implemented method comprising:

identifying coordinates of a portion, of a touchscreen display of a device, that receives a touch input;

identifying an input instant, wherein the input instant is an instant at which the touchscreen display receives the touch input;

determining device motion, including angular acceleration, velocity and orientation, during a input motion interval ending at the input instant and having a predetermined duration that is an estimated user response time, the device motion affects an accuracy of the coordinates of the touch input;

determining a positional vector that is a two dimensional representation of the device motion in a plane of the touch screen taken from components of the device motion; and

adjusting the coordinates with a compensation motion vector that is equal in magnitude and opposite in direction to the positional vector.

11. The computer-implemented method of claim 10, further comprising:

associating the adjusted coordinates with a graphical user interface (GUI) object located at the adjusted coordinates.

12. The computer-implemented method of claim 10, further comprising:

determining an output associated with the touch input based on the adjusted coordinates; and

further adjusting the output using a secondary predictive process.

13. The computer-implemented method of claim 10, wherein determining the change in device motion further comprises:

receiving a plurality of device motion values over the input motion interval; and

determining the device motion based on the plurality of device motion values.

14. The computer-implemented method of claim 13, wherein identifying the input motion interval further comprises:

providing a simulated touch input test that includes a configuration of graphical user interface (GUI) objects displayed on the touchscreen display and that move relative to the touchscreen display to simulate device motion; and

determining the input motion interval based on the simulated touch input test.

15. The computer-implemented method of claim 14, wherein determining the input motion interval based on the simulated touch input test further comprises:

identifying an expected touch input at an expected touch location;

receiving a test touch input at a test touch location;

identifying a simulated device motion associated with the test touch input;

determining a distance between the test touch location and the expected touch location; and

determining the input motion interval based on the simulated device motion and the distance between the test touch location and the expected touch location.

16. The computer-implemented method of claim 10, further comprising:

determining the orientation based on one or more of a yaw, pitch, or roll of the device in a multi-coordinate system.

17. The computer-implemented method of claim 10, further comprising:

providing the adjusted coordinates as an input for a primary application, wherein the primary application includes one of an email program, a texting program, a web browser, and a gaming application.