Compensating for anticipated movement of a device

• US 8,279,242 B2
• Filed: 09/26/2008
• Issued: 10/02/2012
• Est. Priority Date: 09/26/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Bentley, Devlin David
• Primary Examiner(s): Johnson, M Good
• Application Number:
  US12/239,277
• Publication Number:
  US 20100079485A1
• Time in Patent Office: 1,467 Days
• Field of Search: 345/672, 345/156
• US Class Current: 345/672
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10

Abstract

Anticipating movement of a display device and compensating for the anticipated movement. As a user performs an activity while viewing the device, the device experiences movement. The movement is compared to pattern data associated with profiles. One of the profiles is selected based on the comparison. Based at least on compensation data associated with the profile, image data for display on the device is modified to compensate for the anticipated movement. In some embodiments, the image data is shifted horizontally and/or vertically relative to a display area of the device in the opposite direction of the anticipated movement.

Claims

1. A system for anticipating and compensating for display jitter on a mobile computing device, said system comprising:

a memory area for storing one or more profiles describing human gait, each of said profiles including pattern data and compensation data, wherein the pattern data includes a sequence of anticipated movements of the mobile computing device including a direction and magnitude of each of the anticipated movements, wherein the compensation data describes a sequence of adjustments to image data as a user of the mobile computing device walks with the mobile computing device; and

a processor programmed to;

continually receive data from at least one accelerometer in the mobile computing device;

compare the received data to the pattern data of the profiles;

identify one of the profiles based on the comparison;

receive the image data for display on the mobile computing device;

adjust the received image data based on the compensation data associated with the identified one of the profiles and based on the continually received data from the accelerometer to counteract the sequence of anticipated movements in the pattern data; and

provide the adjusted image data for display on the mobile computing device, wherein the adjusted image data compensates for anticipated jitter of the mobile computing device as the user walks with the mobile computing device.

2. The system of claim 1, wherein the processor is programmed to adjust the received image data by shifting the image data in a vertical direction opposite to the anticipated jitter by one or more pixel rows relative to a display area on the mobile computing device to maintain a line of sight between the user and the mobile computing device.

3. The system of claim 1, wherein the mobile computing device comprises a plurality of accelerometers providing data in three spatial dimensions.

4. The system of claim 1, wherein the processor is further programmed to calculate a frequency of movement of the mobile computing device based on the received data from the accelerometer, and wherein the processor is programmed to dynamically alter the compensation data based on the calculated frequency of movement.

5. The system of claim 1, further comprising means for adjusting the image data responsive to anticipated movement of the mobile computing device, and further comprising means for adjusting the image data based on the compensation data associated with the identified one of the profiles and based on the continually received data from the accelerometer.

6. A method comprising:

accessing a plurality of profiles describing anticipated movements of a display device over time, each of said profiles being associated with a different activity performed by a user, each of said profiles including pattern data and compensation data, wherein the pattern data includes a sequence of the anticipated movements of the display device, wherein the compensation data describes a relationship between image data and a display area of the display device as the display device moves over time;

receiving data from at least one accelerometer associated with the display device;

comparing the received data to the pattern data of the profiles;

identifying one of the profiles based on the comparison;

receiving image data intended for the display device;

applying the compensation data associated with the identified one of the profiles and based on the received data from the accelerometer to adjust the received image data relative to the display area to counteract the sequence of anticipated movements in the pattern data; and

providing the adjusted image data for display on the display device, wherein the adjusted image data dynamically compensates for anticipated movement of the display device over time.

7. The method of claim 6, wherein accessing the profiles comprises accessing the profiles describing movement of the display device comprising one or more of the following:

a mobile computing device, a personal digital assistant, a portable music player, a portable gaming console, and a cellular telephone.

8. The method of claim 6, wherein receiving the data from the accelerometer comprises receiving the data from an accelerometer associated with a vehicle in which the display device is contained.

9. The method of claim 6, wherein receiving the data from the accelerometer comprises receiving data from at least three accelerometers, wherein the three accelerometers collectively provide acceleration data in three spatial dimensions.

10. The method of claim 6, wherein accessing the profiles comprises accessing profiles for one or more of the following activities:

walking, running, jogging, and riding in a motor vehicle.

11. The method of claim 6, further comprising calculating an anticipated movement of the display device at a subsequent time based on the pattern data, compensation data, and received data from the accelerometer, and wherein applying the compensation data comprises applying the compensation data as a function of the calculated anticipated movement of the display device to adjust the received image data.

12. The method of claim 6, wherein applying the compensation data comprises vertically shifting the received image data by a quantity of rows of pixels relative to the display area in a direction opposite movement of the display device, said quantity of rows of pixels being defined by the compensation data.

13. The method of claim 6, wherein applying the compensation data comprises horizontally shifting the received image data by a quantity of columns of pixels relative to the display area in a direction opposite movement of the display device, said quantity of columns of pixels being defined by the compensation data.

14. The method of claim 6, further comprising:

receiving notification of an event associated with movement of the display device; and

selecting another one of the profiles responsive to the received notification.

15. The method of claim 14, wherein receiving the notification comprises receiving notification of one or more of the following:

connection of the display device to a vehicle, disconnection of the display device from a vehicle, a speed of the display device exceeding a threshold, and a speed of the display device falling below a threshold.

16. One or more computer storage media having computer-executable components for maintaining a line of sight between a user and a display device during movement of the display device, said components comprising:

a customization component for defining a plurality of profiles describing movement of the display device over time for the user, each of said defined profiles being associated with a different activity performed by the user;

an interface component for receiving data describing movement of the display device;

a jitter component for identifying, based on the data received by the interface component, one of the profiles defined by the customization component and calculating an anticipated movement of the display device based on the identified profile and the data received by the interface component;

a rectifier component for modifying image data for display based on the anticipated movement calculated by the jitter component to compensate for the anticipated movement; and

a driver component for displaying the image data modified by the rectifier component.

17. The computer storage media of claim 16, wherein the jitter component calculates an anticipated movement of the display device away from the user, and wherein the rectifier component modifies the image data by magnifying the image data to maintain a constant zoom factor for the image data.

18. The computer storage media of claim 16, wherein the display device includes a standard display area, and wherein the rectifier component modifies the image data such that a portion of the modified image data is displayed outside the standard display area.

19. The computer storage media of claim 16, wherein the customization component prompts the user to provide physical characteristics of the user, and wherein the customization component defines the profiles based at least on the provided physical characteristics of the user.

20. The computer storage media of claim 16, wherein the interface component further calculates a time-based average of the received data, and wherein the jitter component calculates the anticipated movement based on the calculated time-based average.