System and Method for Compensating for Drift in a Display of a User Interface State

• US 20120086725A1
• Filed: 06/21/2011
• Published: 04/12/2012
• Est. Priority Date: 10/07/2010
• Status: Active Grant

• Current Assignee: Sensor Platforms, Incorporated (Knowles Corporation)
• Original Assignee: Sensor Platforms, Incorporated (Knowles Corporation)
• Inventors: Chen, Ian, Joseph, Benjamin E.
• Granted Patent: US 8,957,909 B2
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry

Abstract

A system, a computer readable storage medium including instructions, and a method for adjusting a displayed user interface in accordance with a navigational state of a human interface device. For each measurement epoch, a base set of operations are performed, including: determining an unmodified user interface state in accordance with the navigational state, and generating current user interface data. When an error introducing state is detected, additional operations are performed, including: determining a modified user interface state; adjusting the current user interface data in accordance with the modified user interface state; and determining a user interface state error. When an error compensating state is detected, additional operations are performed, including: determining a compensation adjustment and adjusting the current user interface data and user interface state error in accordance with the compensation adjustment. The current user interface data enables a current user interface to be displayed.

Claims

1. A method for adjusting a displayed user interface in accordance with a navigational state of a human interface device, comprising:

at a computer system including one or more processors and memory storing one or more programs, the one or more processors executing the one or more programs to perform the operations of;

for each measurement epoch, performing a base set of operations comprising;

determining an unmodified user interface state in accordance with the navigational state of the human interface device; and

generating current user interface data enabling a current user interface to be displayed in accordance with the unmodified user interface state;

upon detecting an error introducing state of the human interface device, the method includes for each measurement epoch, performing the base set of operations and additional operations comprising;

determining a modified user interface state;

adjusting the current user interface data in accordance with the modified user interface state; and

determining a user interface state error based on a difference between the modified user interface state and the unmodified user interface state; and

upon detecting an error compensating state of the human interface device, the method includes for each measurement epoch, performing the base set of operations and additional operations comprising;

determining a compensation adjustment in accordance with the unmodified user interface state and the user interface state error;

adjusting the current user interface data in accordance with the compensation adjustment; and

reducing the user interface state error in accordance with the compensation adjustment; and

performing an operation using the current user interface data so as to enable the current user interface to be displayed.

2. The method of claim 1, wherein the current user interface data includes cursor position data corresponding to a cursor position in the currently displayed user interface.

3. The method of claim 2, wherein the cursor position data is selected from the group consisting of:

data relating to a change in the cursor position between measurement epochs;

data relating to a velocity associated with the change in the cursor position between measurement epochs;

data relating to an absolute coordinate of the cursor position; and

data relating to a relative coordinate of the cursor position.

4. The method of claim 1, wherein the current user interface data includes data corresponding to a location of one or more user interface objects overlaid on a dynamic background, wherein the dynamic background is a background that changes in accordance with changes in actual position and attitude of the human interface device.

5. The method of claim 1, wherein the human interface device includes a camera, and the current user interface data includes data corresponding to a location of one or more user interface objects overlaid on a dynamic background, wherein the dynamic background is an image corresponding to camera data from the camera.

6. The method of claim 1, wherein the current user interface data includes data enabling selection of a portion of a larger user interface that is to be currently displayed to a user of the human interface device.

7. The method of claim 6, wherein:

the larger user interface is a virtual world and the current user interface is a portion of the virtual world that is selected based on a simulated viewpoint of the user in the virtual world.

8. The method of claim 1, wherein determining the modified user interface state includes determining the modified user interface state based on a heuristic function, wherein the heuristic function introduces a heuristic error between the unmodified user interface state and the modified user interface state.

9. The method of claim 8, wherein the heuristic function is selected from the group consisting of:

a function that reduces jitter produced by the user when a button is pressed on the human interface device;

a function that reduces unintended movements of the human interface device produced when the user holds the human interface device;

a function that creates a deadband in movement of one or more elements of the user interface;

a function that has a non-constant gain relationship between the navigational state and a position of one or more elements of the user interface; and

a function that constrains movement of one or more elements of the user interface to a predefined path.

10. The method of claim 1, wherein adjusting the current user interface in accordance with the compensation adjustment includes:

calculating a feedback direction associated with the user interface state error;

calculating a feedback magnitude as a predetermined function of a magnitude of a change in the unmodified user interface state between a prior measurement epoch and a current measurement epoch;

adjusting the current user interface data by adding the feedback magnitude in the feedback direction to the unmodified user interface state.

11. The method of claim 1, wherein the error compensating state and the error introducing state occur concurrently.

12. The method of claim 1, wherein the base set of operations further comprises:

acquiring one or more sensor inputs from sensors on the human interface device; and

calculating the navigational state of the human interface device, in accordance with the acquired sensor inputs, as the human interface device is moved by a user.

13. The method of claim 1, wherein the human interface device includes:

one or more absolute sensors; and

one or more relative sensors.

14. A system, comprising:

one or more processors;

memory; and

one or more programs stored in the memory, the one or more programs comprising instructions to;

for each measurement epoch, perform a base set of operations comprising;

determining an unmodified user interface state in accordance with the navigational state of the human interface device; and

generating current user interface data enabling a current user interface to be displayed in accordance with the unmodified user interface state;

upon detecting an error introducing state of the human interface device, for each measurement epoch, perform the base set of operations and additional operations comprising;

determining a modified user interface state;

adjusting the current user interface data in accordance with the modified user interface state;

determining a user interface state error based on a difference between the modified user interface state and the unmodified user interface state; and

upon detecting an error compensating state of the human interface device, for each measurement epoch, perform the base set of operations and additional operations comprising;

determining a compensation adjustment in accordance with the unmodified user interface state and the user interface state error;

adjusting the current user interface data in accordance with the compensation adjustment; and

reducing the user interface state error in accordance with the compensation adjustment; and

perform an operation using the current user interface data so as to enable the current user interface to be displayed.

15. The system of claim 14, wherein the current user interface data includes cursor position data corresponding to a cursor position in the currently displayed user interface.

16. The system of claim 14, wherein the current user interface data includes data corresponding to a location of one or more user interface objects overlaid on a dynamic background, wherein the dynamic background is a background that changes in accordance with changes in actual position and attitude of the human interface device.

17. The system of claim 14, wherein the human interface device includes a camera, and the current user interface data includes data corresponding to a location of one or more user interface objects overlaid on a dynamic background, wherein the dynamic background is an image corresponding to camera data from the camera.

18. The system of claim 14, wherein the current user interface data includes data enabling selection of a portion of a larger user interface that is to be currently displayed to a user of the human interface device.

19. The system of claim 14, wherein adjusting the current user interface in accordance with the compensation adjustment includes:

calculating a feedback direction associated with the user interface state error;

calculating a feedback magnitude as a predetermined function of a magnitude of a change in the unmodified user interface state between a prior measurement epoch and a current measurement epoch;

adjusting the current user interface data by adding the feedback magnitude in the feedback direction to the unmodified user interface state.

20. A non-transitory computer readable storage medium storing one or more programs configured for execution by a computer system, the one or more programs comprising instructions to:

for each measurement epoch, perform a base set of operations comprising;

determining an unmodified user interface state in accordance with the navigational state of the human interface device; and

generating current user interface data enabling a current user interface to be displayed in accordance with the unmodified user interface state;

upon detecting an error introducing state of the human interface device, for each measurement epoch, perform the base set of operations and additional operations comprising;

determining a modified user interface state;

adjusting the current user interface data in accordance with the modified user interface state;

determining a user interface state error based on a difference between the modified user interface state and the unmodified user interface state; and

upon detecting an error compensating state of the human interface device, for each measurement epoch, perform the base set of operations and additional operations comprising;

determining a compensation adjustment in accordance with the unmodified user interface state and the user interface state error;

adjusting the current user interface data in accordance with the compensation adjustment; and

reducing the user interface state error in accordance with the compensation adjustment; and

perform an operation using the current user interface data so as to enable the current user interface to be displayed.

21. The computer readable storage medium of claim 20, wherein the current user interface data includes cursor position data corresponding to a cursor position in the currently displayed user interface.

22. The computer readable storage medium of claim 20, wherein the current user interface data includes data corresponding to a location of one or more user interface objects overlaid on a dynamic background, wherein the dynamic background is a background that changes in accordance with changes in actual position and attitude of the human interface device.

23. The computer readable storage medium of claim 20, wherein the human interface device includes a camera, and the current user interface data includes data corresponding to a location of one or more user interface objects overlaid on a dynamic background, wherein the dynamic background is an image corresponding to camera data from the camera.

24. The computer readable storage medium of claim 20, wherein the current user interface data includes data enabling selection of a portion of a larger user interface that is to be currently displayed to a user of the human interface device.

25. The computer readable storage medium of claim 20, wherein adjusting the current user interface in accordance with the compensation adjustment includes:

calculating a feedback direction associated with the user interface state error;

calculating a feedback magnitude as a predetermined function of a magnitude of a change in the unmodified user interface state between a prior measurement epoch and a current measurement epoch;

adjusting the current user interface data by adding the feedback magnitude in the feedback direction to the unmodified user interface state.