3D pointing devices with orientation compensation and improved usability

• US 7,414,611 B2
• Filed: 06/20/2007
• Issued: 08/19/2008
• Est. Priority Date: 04/30/2004
• Status: Active Grant

• Current Assignee: DRNC Holdings, Inc. (InterDigital, Inc.)
• Original Assignee: Hillcrest Laboratories Incorporated (CEVA Incorporated)
• Inventors: Liberty, Matthew G.
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US11/820,517
• Publication Number:
  US 20070257885A1
• Time in Patent Office: 426 Days
• Field of Search: 345156-169, 345173-179, 178 1801- 1807, 178 1901- 1906
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42206 characterized by hardware details
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

Systems and methods according to the present invention describe 3D pointing devices which enhance usability by transforming sensed motion data from a first frame of reference (e.g., the body of the 3D pointing device) into a second frame of reference (e.g., a user'"'"'s frame of reference). One exemplary embodiment of the present invention removes effects associated with a tilt orientation in which the 3D pointing device is held by a user.

Claims

1. A system comprising:

means for generating, from a first sensor, a first output associated with motion of a handheld device;

means for detecting, by a second sensor, acceleration of said handheld device and outputting at least one second output; and

means for processing said first output and said at least one second output, said processing means including;

means for determining an orientation in which said handheld device is held using said at least one second output; and

means for compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of said orientation.

2. The system of claim 1, wherein said system further comprises:

means for controlling; and

means for transmitting data, disposed in said handheld device, from said hand held device to said means for controlling,

wherein said means for processing is disposed within one of said handheld device and said means for controlling.

3. The system of claim 1, wherein said first sensor is a camera.

4. The system of claim 1, wherein said first sensor is a rotational sensor.

5. The system of claim 1, wherein said first sensor is a magnetometer.

6. The system of claim 1, wherein said first sensor is an optical sensor.

7. The system of claim 1, wherein said second sensor is a multi-axis accelerometer and wherein said at least one second output includes a value y generated by said multi-axis accelerometer associated with acceleration of said handheld device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said handheld device in a z-axis direction.

8. The system of claim 7, wherein said multi-axis accelerometer is a 3-axis accelerometer.

9. The system of claim 1, wherein said first output is generated at a sampling rate of 200 samples/second.

10. The system of claim 1, wherein said means for transmitting data is a Bluetooth®

transceiver.

11. The system of claim 1, further comprising:

a plurality of buttons disposed on a housing of said handheld device; and

at least one LED disposed on said housing.

12. The system of claim 1, wherein said first output includes position data values.

13. The system of claim 1, wherein said means for processing performs said two-dimensional rotational transformation on translational motion detected by said first sensor.

14. The system of claim 1, wherein said means for processing performs said two-dimensional rotational transform on rotational motion detected by said first sensor.

15. The system of claim 1, wherein said means for processing performs said two-dimensional rotational transform on both translational motion and rotational motion detected by said first sensor.

16. The system of claim 1, wherein at least one of said first output and said at least one second output are processed prior to said compensating.

17. The system of claim 16, wherein said processing prior to said compensating includes compensating said at least one of said first output and said at least one second output for offset bias.

18. The system of claim 16, wherein said processing prior to compensating includes converting said at least one of said first output and said at least one second output into different units.

19. The system of claim 1, wherein said handheld device is a 3D pointing device.

20. A method for using a free space pointing device comprising the steps of:

detecting movement of said free space pointing device using an accelerometer and at least one other sensor;

determining an orientation in which said free space pointing device is held; and

compensating said at least one other sensor'"'"'s detected movement based on said determined orientation by performing a two-dimensional rotational transform on said at least one other sensor'"'"'s detected movement to generate an output which is substantially independent of said orientation.

21. The method of claim 20, further comprising:

transmitting data from said handheld device to a system controller, wherein said determining and compensating are performed within one of said handheld device and said system controller.

22. The method of claim 20, wherein said at least one other sensor is a camera.

23. The method of claim 20, wherein said at least one other sensor is a rotational sensor.

24. The method of claim 20, wherein said at least one other sensor is a magnetometer.

25. The method of claim 20, wherein said at least one other sensor is an optical sensor.

26. The method of claim 20, wherein said accelerometer is a multi-axis accelerometer and wherein an output of said accelerometer includes a value y generated by said multi-axis accelerometer associated with acceleration of said handheld device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said handheld device in a z-axis direction.

27. The method of claim 26, wherein said multi-axis accelerometer is a 3-axis accelerometer.

28. The method of claim 20, wherein an output of said at least one other sensor is generated at a sampling rate of 200 samples/second.

29. The method of claim 21, wherein said step of transmitting further comprises:

wirelessly transmitting said data in accordance with Bluetooth®

.

30. The method of claim 20, further comprising:

disposing a plurality of buttons and at least one LED on a housing of said handheld device.

31. The method of claim 20, wherein an output of said at least one other sensor includes position data values.

32. The method of claim 20, wherein said compensating performs said two-dimensional rotational transform on translational motion detected by said at least one other sensor.

33. The method of claim 20, wherein said compensating performs said two-dimensional rotational transform on rotational motion detected by said at least one other sensor.

34. The method of claim 20, wherein said compensating performs said two-dimensional rotational transform on both translational motion and rotational motion detected by said at least one other sensor.

35. The method of claim 20, further comprising:

processing at least one of an output of said accelerometer and an output of said at least one other prior to said compensating.

36. The method of claim 35, wherein said processing prior to said compensating includes compensating said at least one of said output of said accelerometer and said output of said at least one other sensor for offset bias.

37. The method of claim 35, wherein said processing prior to said compensating includes converting said at least one of said output of said accelerometer and said output of said at least one other sensor into different units.

38. The method of claim 20, wherein said handheld device is a 3D pointing device.

39. A handheld device comprising:

a sensor for generating a first output associated with motion of said handheld device;

an accelerometer for detecting acceleration of said handheld device and outputting at least one second output;

and a processing unit for receiving and processing said first output from said sensor and said at least one second output from said accelerometer,

said processing including;

determining an orientation in which said handheld device is held using said at least one second output; and

compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of said orientation.

40. The handheld device of claim 39, wherein said sensor is a camera.

41. The handheld device of claim 39, wherein said sensor is a rotational sensor.

42. The handheld device of claim 39, wherein said sensor is a magnetometer.

43. The handheld device of claim 39, wherein said sensor is an optical sensor.

44. The handheld device of claim 39, wherein said accelerometer is a multi-axis accelerometer and wherein said at least one second output includes a value y generated by said multi-axis accelerometer associated with acceleration of said handheld device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said handheld device in a z-axis direction.

45. The handheld device of claim 44, wherein said multi-axis accelerometer is a 3-axis accelerometer.

46. The handheld device of claim 39, wherein said first output is generated at a sampling rate of 200 samples/second.

47. The handheld device of claim 39, further comprising:

a wireless transceiver for receiving data from said processing unit and wirelessly transmitting said data.

48. The handheld device of claim 47, wherein said wireless transceiver is a Bluetooth®

transceiver.

49. The handheld device of claim 39, further comprising:

a plurality of buttons disposed on a housing of said handheld device; and

at least one LED disposed on said housing.

50. The handheld device of claim 39, wherein said first output includes position data values.

51. The handheld device of claim 39, wherein said processing performs said two dimensional rotational transform on detected translational motion of said handheld device.

52. The handheld device of claim 39, wherein said processing performs said two dimensional rotational transform on detected rotational motion of said handheld device.

53. The handheld device of claim 39, wherein said processing performs said two dimensional rotational transform on both detected translational motion and detected rotational motion of said handheld device.

54. The handheld device of claim 39, wherein said handheld device is a 3D pointing device.

55. The device of claim 39, wherein at least one of said first output and said at least one second output are processed prior to said compensating.

56. The device of claim 55, wherein said processing prior to said compensating includes compensating said at least one of said first output and said at least one second output for offset bias.

57. The device of claim 55, wherein said processing prior to said compensating includes converting said at least one of said first output and said at least one second output into different units.

58. A system comprising:

(a) a handheld device including;

a sensor for generating a first output associated with motion of said handheld device; and

an accelerometer for detecting acceleration of said handheld device and outputting at least one second output; and

(b) a processing unit for receiving and processing said first output from said sensor and said at least one second output from said accelerometer, said processing including;

determining an orientation in which said handheld device is held using said at least one second output; and

compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of said orientation.

59. The system of claim 58, wherein said system further comprises:

a system controller;

a wireless transceiver, disposed in said hand held device, for transmitting data from said handheld device to said system controller;

wherein said processing unit is disposed within one of said hand held device and said system controller.

60. The system of claim 58, wherein said sensor is a camera.

61. The system of claim 58, wherein said sensor is a rotational sensor.

62. The system of claim 58, wherein said sensor is a magnetometer.

63. The system of claim 58, wherein said sensor is an optical sensor.

64. The system of claim 58, wherein said accelerometer is a multi-axis accelerometer and wherein said at least one second output includes a value y generated by said multi-axis accelerometer associated with acceleration of said handheld device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said handheld device in a z-axis direction.

65. The system of claim 64, wherein said multi-axis accelerometer is a 3-axis accelerometer.

66. The system of claim 58, wherein said first output is generated at a sampling rate of 200 samples/second.

67. The system of claim 59, wherein said wireless transceiver is a Bluetooth®

transceiver.

68. The system of claim 58, further comprising:

a plurality of buttons disposed on a housing of said handheld device; and

at least one LED disposed on said housing.

69. The system of claim 58, wherein said first output includes position data values.

70. The system of claim 58, wherein said processing unit performs said two-dimensional rotational transformation on translational motion detected by said sensor.

71. The system of claim 58, wherein said processing unit performs said two-dimensional rotational transform on rotational motion detected by said sensor.

72. The system of claim 58, wherein said processing unit performs said two-dimensional rotational transform on both translational motion and rotational motion detected by said sensor.

73. The system of claim 58, wherein at least one of said first output and said at least one second output are processed prior to said compensating.

74. The system of claim 73, wherein said processing prior to said compensating includes compensating said at least one of said first output and said at least one second output for offset bias.

75. The system of claim 73, wherein said processing prior to compensating includes converting said at least one of said first output and said at least one second output into different units.

76. The system of claim 58, wherein said handheld device is a 3D pointing device.

77. A method comprising:

generating, from a first sensor, a first output associated with motion of a handheld device;

detecting, by a second sensor, acceleration of said handheld device and outputting at least one second output; and

processing said first output and said at least one second output, said processing including;

determining an orientation in which said handheld device is held using said at least one second output; and

compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of said orientation.

78. The method of claim 77, further comprising:

transmitting data from said handheld device to a system controller, wherein said processing is performed within one of said handheld device and said system controller.

79. The method of claim 77, wherein said first sensor is a camera.

80. The method of claim 77, wherein said first sensor is a rotational sensor.

81. The method of claim 77, wherein said first sensor is a magnetometer.

82. The method of claim 77, wherein said first sensor is an optical sensor.

83. The method of claim 77, wherein said second sensor is a multi-axis accelerometer and wherein said at least one second output includes a value y generated by said multi-axis accelerometer associated with acceleration of said handheld device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said handheld device in a z-axis direction.

84. The method of claim 83, wherein said multi-axis accelerometer is a 3-axis accelerometer.

85. The method of claim 77, wherein said first output is generated at a sampling rate of 200 samples/second.

86. The method of claim 78, wherein said step of transmitting further comprises:

wirelessly transmitting said data in accordance with Bluetooth®

.

87. The method of claim 77, further comprising:

disposing a plurality of buttons and at least one LED on a housing of said handheld device.

88. The method of claim 77, wherein said first output includes position data values.

89. The method of claim 77, wherein said processing performs said two-dimensional rotational transform on translational motion detected by said first sensor.

90. The method of claim 77, wherein said processing performs said two-dimensional rotational transform on rotational motion detected by said first sensor.

91. The method of claim 77, wherein said processing performs said two-dimensional rotational transform on both translational motion and rotational motion detected by said first sensor.

92. The method of claim 77, further comprising:

processing at least one of said first output and said at least one second output prior to said compensating.

93. The method of claim 92, wherein said processing prior to said compensating includes compensating said at least one of said first output and said at least one second output for offset bias.

94. The method of claim 92, wherein said processing prior to said compensating includes converting said at least one of said first output and said at least one second output into different units.

95. The method of claim 77, wherein said handheld device is a 3D pointing device.