Motion effect reduction for displays and touch input

• US 9,990,003 B2
• Filed: 06/03/2011
• Issued: 06/05/2018
• Est. Priority Date: 06/03/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Bailey, Richard St. Clair
• Primary Examiner(s): MISHLER, ROBIN J
• Application Number:
  US13/152,265
• Publication Number:
  US 20120306768A1
• Time in Patent Office: 2,559 Days
• Field of Search: 345173, 345156-158
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/0418 for error correction or compensation, e.g. based on parallax, calibration or alignment
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 5/00 Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T
• CPC Class Codes: G09G 5/26 for modifying the character dimensions, e.g. double width, double height

Abstract

A movement compensation system is described herein that compensates a user interface and received touch input based on detected external motion affecting a mobile computing device. The system uses the integration of accelerometer data to either offset screen rendering or adjust screen size to improve readability. The system may also improve touch target selection by offsetting received touch coordinates to compensate for device shifting. Offsets can be applied to either the screen rendering offset or can be applied to the touch coordinate input. The system may increase font size or the size of other user interface elements in response to detecting external motion. The system may also receive tuning parameters to account for device mass, dampening filters on accelerometer integrations, latency effects, and user responsiveness to motion effects. Thus, the system allows users to continue to use devices under high motion environmental conditions.

Claims

1. A computer-implemented method that compensates for detected motion that affects use of a mobile computing device, the method comprising:

loading configuration parameters for determining how to compensate for detected motion of the mobile computing device, including loading a dampening factor configured to reduce motion compensation based on an amount that a user compensates for motion;

watching for motion of the mobile computing device by reading motion data from one or more motion sensors associated with the mobile computing device;

upon detecting motion of the mobile computing device, processing the motion data from the one or more motion sensors that detected motion by applying the loaded configuration parameters to determine a type of motion compensation to apply in response to the detected motion, wherein applying the loaded configuration parameters comprises applying the dampening factor to the detected motion to reduce an amount of compensation of the detected motion based on an amount that the user compensates for motion;

performing a motion compensation action that modifies displayed information or received input in response to the detected motion, wherein the motion compensation is based on the loaded configuration parameters, including the dampening factor; and

wherein the preceding steps are performed by one or more processors.

2. The method of claim 1 wherein loading configuration parameters comprises accessing parameters that include device characteristics that affect motion compensation.

3. The method of claim 1 wherein loading configuration parameters comprises accessing parameters that include user preferences related to motion compensation.

4. The method of claim 1 wherein watching for motion comprises accessing information from sensors selected from the group consisting of an accelerometer, a gyroscope, a GPS receiver, and a shock sensor.

5. The method of claim 1 wherein watching for motion comprises accessing information from a sensor external to the mobile computing device located proximate the mobile computing device.

6. The method of claim 1 wherein detecting motion of the mobile computing device comprises receiving a software event provided by motion-detecting hardware to an operating system running on the mobile computing device.

7. The method of claim 1 wherein processing the motion data comprises receiving coordinates that specify direction and distance of detected motion.

8. The method of claim 1 wherein processing the motion data comprises pre-translating received coordinates to relate the coordinates to a screen orientation.

9. The method of claim 1 wherein applying configuration parameters comprises determining a magnitude of compensation response to apply to detected motion of the mobile computing device.

10. The method of claim 1 wherein applying configuration parameters comprises determining whether the detected motion of the mobile computing device satisfies a configured motion threshold for applying motion compensation.

11. The method of claim 1 wherein performing a motion compensation action comprises translating a screen image to a new location relative to the device screen based on the detected motion.

12. The method of claim 1 wherein performing a motion compensation action comprises resizing fonts, text margins, or other user interface elements to make the elements easier for the user to see during the detected motion.

13. The method of claim 1 wherein performing a motion compensation action comprises translating a position of incoming touch input.

19. The method of claim 1, wherein loading configuration parameters for determining how to compensate for detected motion of the mobile computing device comprises loading user characteristic information comprising one or more physical traits of a user of the mobile computing device such that the one or more physical traits can be used to compensate for detected motion of the mobile computing device, wherein the physical traits comprise at least one of the user'"'"'s age, responsiveness of the user to motion, or a reaction time of the user.

20. The method of claim 19 further comprising:

asking the user to attempt to hit a target displayed to the user on the mobile computing device, while the mobile computing device is moving;

receiving input from the user attempting to hit the target, while the mobile computing device is moving;

using the input from the user, determining the user'"'"'s perception of the location of the target;

determining the loaded configuration parameters based on the user'"'"'s perception of the location of the target.

14. A computer system for motion effect reduction for displays and touch input on a mobile computing device, the system comprising:

a processor and memory configured to execute software instructions embodied within the following components;

a configuration component configured to receive one or more configuration parameters that affect motion compensation applied by the system, wherein the configuration component is configured to receive a dampening factor configured to reduce motion compensation based on an amount that a user compensates for motion;

a motion detection component configured to detect motion that affects the mobile computing device;

a motion processing component configured to process the detected motion to determine an appropriate motion compensation response;

a translation component configured to translate a user interface of the mobile computing device by shifting one or more displayed user interface elements in a direction related to the detected motion;

a resizing component configured to resize one or more user interface elements in response to the detected motion; and

an input adjustment component configured to adjust received input in response to detected motion to correct coordinates of received input to a location where the component determines the input would have been but for the detected motion.

15. The system of claim 14 wherein the motion detection component comprises one or more accelerometers, gyroscopes, or other position or motion sensors that are configured to inform the system that the detected motion has occurred and a magnitude and direction of the detected motion.

16. The system of claim 14 wherein the motion processing component is configured to enforce a threshold on the level of motion before compensation is applied.

17. The system of claim 14 wherein the translation component is configured to provide a virtual screen area that is larger than a physical screen of the mobile computing device, so that translation can be performed by making some parts of the virtual screen visible on the physical screen using graphical hardware of the mobile computing device to reduce burden on the processor.

18. The system of claim 14 wherein the resizing component is configured to increase a font size to make text displayed on the mobile computing device more readable during the detected motion.