Easily deployable interactive direct-pointing system and calibration method therefor

• US 9,285,897 B2
• Filed: 07/07/2006
• Issued: 03/15/2016
• Est. Priority Date: 07/13/2005
• Status: Active Grant

• Current Assignee: UltimatePointer, LLC
• Original Assignee: UltimatePointer, LLC
• Inventors: Banning, Erik Jan
• Primary Examiner(s): PHAM, VIET DAVID
• Application Number:
  US11/483,170
• Publication Number:
  US 20070013657A1
• Time in Patent Office: 3,539 Days
• Field of Search: 345156-158, 348/734
• US Class Current: 1/1
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A method for controlling a computer display cursor in an interaction region includes projecting an image of the computer display to create the interaction region. A distance is established between a first point and a second point. The first point has a predetermined relation to the projection device, and the second point has a predetermined relation to the interaction region. At least one of an orientation and a position of a pointing line is measured. The pointing line has a predetermined relation to a pointing device. The established distance and the at least one of measured position and orientation are used to control the cursor position on the interaction region.

Claims

1. A method for controlling a feature on a display using a handheld pointing device, the method comprising:

sampling data;

determining from the sampled data a distance between the pointing device and a point lying outside of the display and having only a partially known relation with the display; and

using the distance as one parameter to provide data to control the feature on the display.

5. The method according to claim 1, wherein controlling the feature on the display comprises controlling a zoom event.

2. A method for controlling a feature on a display using a handheld pointing device, the method comprising:

sampling first calibration data while the pointing device is directed at a first calibration location, the first calibration location having a known relation to the display;

sampling third data while the pointing device is directed at a third location lying outside of the display and having an at least partially known relation with the display;

determining from the sampled third data a distance between the pointing device and the third location lying outside of the display and having an at least partially known relation with the display; and

using the distance and the sampled first calibration data together to provide data to control the feature on the display.

3. The method of claim 2, further comprising:

sampling second calibration data while the pointing device is directed at a second calibration location, the second calibration location having a known relation to the display; and

using the second sampled calibration data together with the distance and sampled first calibration data to provide data to control the feature on the display.

4. The method according to claim 2, wherein the feature on the display is the position of a cursor on the display.

6. A method for controlling movement of a cursor on a display using a handheld pointing device which has a pointing line having a predetermined relation with the pointing device, the method comprising:

sampling cursor calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed to substantially pass through the cursor position;

determining first characteristics of the pointing device with reference to the display from the sampled cursor calibration data;

sampling non-calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed away from the cursor position; and

providing data to move the cursor based on the sampled non-calibration data and the first characteristics of the pointing device.

7. The method of claim 6, wherein the sampled data includes the orientation of the pointing device.

8. The method of claim 6, further comprising:

sampling first calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed to substantially pass through a first calibration location with a known relation to the display;

determining second characteristics of the pointing device with reference to the display from the sampled first calibration data; and

providing data to move the cursor based on the second characteristics determined from the first calibration data.

9. The method of claim 8, further comprising:

sampling second calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed to substantially pass through a second calibration location with a known relation to the display;

determining third characteristics of the pointing device with reference to the display from the sampled second calibration data; and

providing data to move the cursor based on the third characteristics determined from the second calibration data.

10. A method for controlling position of a cursor on a display using a handheld pointing device which has a pointing line having a predetermined relation with the pointing device, the method comprising:

sampling calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed to trace out a line between a first point and a second point, the first point having a known relation to the display and the second point having a known relation to the display;

determining characteristics of the display with respect to the pointing device from the sampled calibration data;

sampling non-calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed to a desired cursor location; and

providing data to position the cursor based on the sampled non-calibration data and the characteristics.

11. The method according to claim 10, wherein the sampled data includes the orientation of the pointing device.

12. The method according to claim 11, wherein the first point and the second point are diagonally opposite corners of the display.

13. A method for controlling movement of a cursor on a display using a handheld pointing device, the method comprising:

sampling first calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing device is directed at a first calibration location with a known relation to the display;

constraining positional characteristics of the pointing device with reference to the display from the sampled first calibration data;

sampling non-calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing device is directed at a non-calibration location on the display; and

providing data to move the cursor based on the sampled non-calibration data and the positional characteristics of the pointing device.

14. The method according to claim 13, further comprising:

sampling second calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing device is directed at a second calibration location with a known relation to the display;

wherein the sampled second calibration data is used to further constrain the positional characteristics of the pointing device.

15. The method according to claim 13, wherein the sampled data does not contain positional characteristics of the pointing device.

16. A method for controlling movement of a cursor on a display using a handheld pointing device, the method comprising:

sampling first calibration data developed by sensing devices internal to the pointing device and provided from the pointing device positioned at a first calibration position while the pointing device is being directed at a first calibration location with a known relation to the display;

determining display characteristics with respect to the pointing device from the first sampled calibration data;

sampling second calibration data developed by sensing devices internal to the pointing device and provided from the pointing device positioned at a second calibration position while the pointing device is being directed at a second calibration location with a known relation to the display;

initializing a vertical positional coordinate of the pointing device positioned at the second calibration position to be substantially identical to a vertical positional coordinate of the pointing device positioned at the first calibration position;

determining horizontal positional coordinates of the pointing device positioned at the second calibration position from the sampled second calibration data and the vertical positional coordinate;

directing the pointing device substantially positioned at the second calibration position at a non-calibration location on the display and sampling non-calibration data from the pointing device; and

providing data to move the cursor based on the non-calibration data, the display characteristics, the vertical positional coordinate of the pointing device and the horizontal positional coordinates of the pointing device.

17. The method according to claim 16, further comprising:

sampling third calibration data developed by sensing devices internal to the pointing device and provided from the pointing device substantially positioned at the first calibration position while the pointing device is being directed at a third calibration location with a known relation to the display,

wherein the sampled third calibration data is used in determining display characteristics with respect to the pointing device.

18. The method according to claim 16, wherein the sampled data does not contain positional characteristics of the pointing device.

19. A non-transitory computer-readable medium or media storing computer-executable instructions for directing a computer to perform a method for controlling a feature on a display using a handheld pointing device, the method comprising:

sampling data;

determining from the sampled data a distance between the pointing device and a point lying outside of the display and having only a partially known relation with the display; and

using the distance as one parameter to provide data to control the feature on the display.

23. The non-transitory computer-readable medium or media according to claim 19, wherein controlling the feature on the display comprises controlling a zoom event.

20. A non-transitory computer-readable medium or media storing computer-executable instructions for directing a computer to perform a method for controlling a feature on a display using a handheld pointing device, the method comprising:

sampling first calibration data while the pointing device is directed at a first calibration location, the first calibration location having a known relation to the display;

sampling third data while the pointing device is directed at a third location lying outside of the display and having an at least partially known relation with the display on the display;

determining from the sampled third data a distance between the pointing device and the location lying outside of the display and having an at least partially known relation with the display; and

using the distance and the sampled first calibration data together to provide data to control the feature on the display.

21. The non-transitory computer-readable medium or media of claim 20, the method further comprising:

sampling second calibration data while the pointing device is directed at a second calibration location, the second calibration location having a known relation to the display; and

using the second sampled calibration data together with the distance and sampled first calibration data to provide data to control the feature on the display.

22. The non-transitory computer-readable medium or media according to claim 20, wherein the feature on the display is the position of a cursor on the display.

24. A non-transitory computer-readable medium or media storing computer-executable instructions for directing a computer to perform a method for controlling movement of a cursor on a display using a handheld pointing device which has a pointing line having a predetermined relation with the pointing device, the method comprising:

sampling cursor calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed to substantially pass through the cursor position;

determining first characteristics of the pointing device with reference to the display from the sampled cursor calibration data;

sampling non-calibration data from the pointing device while the pointing line is directed away from the cursor position; and

providing data to move the cursor based on the sampled non-calibration data and the first characteristics of the pointing device.

25. The non-transitory computer-readable medium or media of claim 24, wherein the sampled data includes the orientation of the pointing device.

26. The non-transitory computer-readable medium or media of claim 24, the method further comprising:

sampling first calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed to substantially pass through a first calibration location with a known relation to the display;

determining second characteristics of the pointing device with reference to the display from the sampled first calibration data; and

providing data to move the cursor based on the second characteristics determined from the first calibration data.

27. The non-transitory computer-readable medium or media of claim 26, the method further comprising:

sampling second calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed to substantially pass through a second calibration location with a known relation to the display;

determining third characteristics of the pointing device with reference to the display from the sampled second calibration data; and

providing data to move the cursor based on the third characteristics determined from the second calibration data.

28. A non-transitory computer-readable medium or media storing computer-executable instructions for directing a computer to perform a method for controlling position of a cursor on a display using a handheld pointing device which has a pointing line having a predetermined relation with the pointing device, the method comprising:

sampling calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed to trace out a line between a first point and a second point, the first point having a known relation to the display and the second point having a known relation to the display;

determining characteristics of the display with respect to the pointing device from the sampled calibration data;

sampling non-calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing line is directed to a desired cursor location; and

providing data to position the cursor based on the sampled non-calibration data and the characteristics.

29. The non-transitory computer-readable medium or media according to claim 28, wherein the sampled data includes the orientation of the pointing device.

30. The non-transitory computer-readable medium or media according to claim 29, wherein the first point and the second point are diagonally opposite corners of the display.

31. A non-transitory computer-readable medium or media storing computer-executable instructions for directing a computer to perform a method for controlling movement of a cursor on a display using a handheld pointing device, the method comprising:

sampling first calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing device is directed at a first calibration location with a known relation to the display;

constraining positional characteristics of the pointing device with reference to the display from the sampled first calibration data;

sampling non-calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing device is directed at a non-calibration location on the display; and

providing data to move the cursor based on the sampled non-calibration data and the positional characteristics of the pointing device.

32. The non-transitory computer-readable medium or media according to claim 31, the method further comprising:

sampling second calibration data developed by sensing devices internal to the pointing device and provided from the pointing device while the pointing device is directed at a second calibration location with a known relation to the display;

wherein the sampled second calibration data is used to further constrain the positional characteristics of the pointing device.

33. The non-transitory computer-readable medium or media according to claim 31, wherein the sampled data does not contain positional characteristics of the pointing device.

34. A non-transitory computer-readable medium or media storing computer-executable instructions for directing a computer to perform a method for controlling movement of a cursor on a display using a handheld pointing device, the method comprising:

sampling first calibration data developed by sensing devices internal to the pointing device and provided from the pointing device positioned at a first calibration position while the pointing device is being directed at a first calibration location with a known relation to the display;

determining display characteristics with respect to the pointing device from the first sampled calibration data;

sampling second calibration data developed by sensing devices internal to the pointing device and provided from the pointing device positioned at a second calibration position while the pointing device is being directed at a second calibration location with a known relation to the display;

initializing a vertical positional coordinate of the pointing device positioned at the second calibration position to be substantially identical to a vertical positional coordinate of the pointing device positioned at the first calibration position;

determining horizontal positional coordinates of the pointing device positioned at the second calibration position from the sampled second calibration data and the vertical positional coordinate;

directing the pointing device substantially positioned at the second calibration position at a non-calibration location on the display and sampling non-calibration data from the pointing device; and

providing data to move the cursor based on the sampled non-calibration data, the display characteristics, the vertical positional coordinate of the pointing device and the horizontal positional coordinates of the pointing device.

35. The non-transitory computer-readable medium or media according to claim 34, the method further comprising:

sampling third calibration data developed by sensing devices internal to the pointing device and provided from the pointing device substantially positioned at the first calibration position while the pointing device is being directed at a third calibration location with a known relation to the display,

wherein the sampled third calibration data is used in determining display characteristics with respect to the pointing device.

36. The non-transitory computer-readable medium or media according to claim 34, wherein the sampled data does not contain positional characteristics of the pointing device.

37. A system for controlling a feature on a display using a handheld pointing device, the system comprising:

a central processing unit;

a communication device coupled to said central processing unit to receive data about the handheld pointing device; and

a memory coupled to said central processing unit and storing a program to cause said central processing unit to perform the following method;

sampling data received by said communication device;

determining from the sampled data a distance between the pointing device and a point lying outside of the display and having only a partially known relation with the display; and

using the distance as one parameter to provide data to control the feature on the display.

41. The system according to claim 37, wherein controlling the feature on the display comprises controlling a zoom event.

38. A system for controlling a feature on a display using a handheld pointing device, the system comprising:

a central processing unit;

a communication device coupled to said central processing unit to receive data about the handheld pointing device; and

a memory coupled to said central processing unit and storing a program to cause said central processing unit to perform the following method;

sampling first calibration data received by said communication device while the pointing device is directed at a first calibration location, the first calibration location having a known relation to the display;

sampling third data received by said communication device while the pointing device is directed at a third location lying outside of the display and having an at least partially known relation with the display on the display;

determining from the sampled third data a distance between the pointing device and the location lying outside of the display and having an at least partially known relation with the display; and

using the distance and the sampled first calibration data together to provide data to control the feature on the display.

39. The system of claim 38, the method further comprising:

sampling second calibration data received by said communication device while the pointing device is directed at a second calibration location, the second calibration location having a known relation to the display; and

using the second sampled calibration data together with the distance and sampled first calibration data to provide data to control the feature on the display.

40. The system according to claim 38, wherein the feature on the display is the position of a cursor on the display.

42. A system for controlling movement of a cursor on a display using a handheld pointing device, the handheld pointing device having a pointing line having a predetermined relation with the pointing device, the system comprising:

a central processing unit;

a communication device coupled to said central processing unit to receive data from the handheld pointing device; and

a memory coupled to said central processing unit and storing a program to cause said central processing unit to perform the following method;

sampling cursor calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device while the pointing line is directed to substantially pass through the cursor position;

determining first characteristics of the pointing device with reference to the display from the sampled cursor calibration data;

sampling non-calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device while the pointing line is directed away from the cursor position; and

providing data to move the cursor based on the sampled non-calibration data and the first characteristics of the pointing device.

43. The system according to claim 42, wherein the sampled data includes the orientation of the pointing device.

44. The system according to claim 42, the method further comprising:

sampling first calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device while the pointing line is directed to substantially pass through a first calibration location with a known relation to the display;

determining second characteristics of the pointing device with reference to the display from the sampled first calibration data; and

providing data to move the cursor based on the second characteristics determined from the first calibration data.

45. The system according to claim 44, the method further comprising:

sampling second calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device while the pointing line is directed to substantially pass through a second calibration location with a known relation to the display;

determining third characteristics of the pointing device with reference to the display from the sampled second calibration data; and

providing data to move the cursor based on the third characteristics determined from the second calibration data.

46. A system for controlling movement of a cursor on a display using a handheld pointing device, the handheld pointing device having a pointing line having a predetermined relation with the pointing device, the system comprising:

a central processing unit;

a communication device coupled to said central processing unit to receive data from the handheld pointing device; and

a memory coupled to said central processing unit and storing a program to cause said central processing unit to perform the following method;

sampling calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device while the pointing line is directed to trace out a line between a first point and a second point, the first point having a known relation to the display and the second point having a known relation to the display;

determining characteristics of the display with respect to the pointing device from the sampled calibration data;

sampling non-calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device while the pointing line is directed to a desired cursor location; and

providing data to position the cursor based on the sampled non-calibration data and the characteristics.

47. The system according to claim 46, wherein the sampled data includes the orientation of the pointing device.

48. The system according to claim 47, wherein the first point and the second point are diagonally opposite corners of the display.

49. A system for controlling movement of a cursor on a display using a handheld pointing device, the handheld pointing device having a pointing line having a predetermined relation with the pointing device, the system comprising:

a central processing unit;

a communication device coupled to said central processing unit to receive data from the handheld pointing device; and

a memory coupled to said central processing unit and storing a program to cause said central processing unit to perform the following method;

sampling first calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device while the pointing device is directed at a first calibration location with a known relation to the display;

constraining positional characteristics of the pointing device with reference to the display from the sampled first calibration data;

sampling non-calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device while the pointing device is directed at a non-calibration location on the display; and

providing data to move the cursor based on the sampled non-calibration data and the positional characteristics of the pointing device.

50. The system according to claim 49, the method further comprising:

sampling second calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device while the pointing device is directed at a second calibration location with a known relation to the display;

wherein the sampled second calibration data is used to further constrain the positional characteristics of the pointing device.

51. The system according to claim 49, wherein the sampled data does not contain positional characteristics of the pointing device.

52. A system for controlling movement of a cursor on a display using a handheld pointing device, the handheld pointing device having a pointing line having a predetermined relation with the pointing device, the system comprising:

a central processing unit;

a communication device coupled to said central processing unit to receive data from the handheld pointing device; and

a memory coupled to said central processing unit and storing a program to cause said central processing unit to perform the following method;

sampling first calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device positioned at a first calibration position while the pointing device is being directed at a first calibration location with a known relation to the display;

determining display characteristics with respect to the pointing device from the first sampled calibration data;

sampling second calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device positioned at a second calibration position while the pointing device is being directed at a second calibration location with a known relation to the display;

initializing a vertical positional coordinate of the pointing device positioned at the second calibration position to be substantially identical to a vertical positional coordinate of the pointing device positioned at the first calibration position;

determining horizontal positional coordinates of the pointing device positioned at the second calibration position from the sampled second calibration data and the vertical positional coordinate;

directing the pointing device substantially positioned at the second calibration position at a non-calibration location on the display and sampling non-calibration data from the pointing device; and

providing data to move the cursor based on the sampled non-calibration data, the display characteristics, the vertical positional coordinate of the pointing device and the horizontal positional coordinates of the pointing device.

53. The system according to claim 52, the method further comprising:

sampling third calibration data developed by sensing devices internal to the pointing device and provided from the pointing device and received by said communication device from the pointing device substantially positioned at the first calibration position while the pointing device is being directed at a third calibration location with a known relation to the display,

wherein the sampled third calibration data is used in determining display characteristics with respect to the pointing device.

54. The system according to claim 52, wherein the sampled data does not contain positional characteristics of the pointing device.