3D pointing devices with orientation compensation and improved usability

• US 8,072,424 B2
• Filed: 08/08/2008
• Issued: 12/06/2011
• Est. Priority Date: 04/30/2004
• Status: Active Grant

• Current Assignee: DRNC Holdings, Inc. (InterDigital, Inc.)
• Original Assignee: Hillcrest Laboratories Incorporated (CEVA Incorporated)
• Inventors: Liberty, Matthew G.
• Primary Examiner(s): Shankar, Vijay
• Application Number:
  US12/188,595
• Publication Number:
  US 20080291163A1
• Time in Patent Office: 1,215 Days
• Field of Search: 345156-169, 345173-179, 178 1801- 1809, 178 1901- 1906
• US Class Current: 345/158
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/42206 characterized by hardware details
• CPC Class Codes: H04N 21/42222 Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device

Abstract

Systems and methods according to the present invention describe 3D pointing devices which enhance usability by transforming sensed motion data from a first frame of reference (e.g., the body of the 3D pointing device) into a second frame of reference (e.g., a user'"'"'s frame of reference). One exemplary embodiment of the present invention removes effects associated with a tilt orientation in which the 3D pointing device is held by a user.

Claims

1. A method for using a free space pointing device comprising the steps of:

detecting movement of said free space pointing device using an accelerometer and at least one other sensor;

determining an orientation, in which said free space pointing device is held, based on an output of said accelerometer;

compensating said at least one other sensor'"'"'s detected movement based on said determined orientation by performing a two-dimensional rotational transform on said at least one other sensor'"'"'s detected movement to generate an output which is substantially independent of a tilt of said free space pointing device with reference to a predetermined axis; and

determining a gesture associated with the detected movement.

78. The method of claim 1, further comprising:

transmitting data from said handheld device to a system controller, wherein said determining and compensating are performed within one of said handheld device and said system controller.

79. The method of claim 1, wherein said at least one other sensor is a camera.

80. The method of claim 1, wherein said at least one other sensor is a rotational sensor.

81. The method of claim 1, wherein said at least one other sensor is a magnetometer.

82. The method of claim 1, wherein said at least one other sensor is an optical sensor.

83. The method of claim 1, wherein said accelerometer is a multi-axis accelerometer and wherein an output of said accelerometer includes a value y generated by said multi-axis accelerometer associated with acceleration of said handheld device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said handheld device in a z-axis direction.

84. The method of claim 83, wherein said multi-axis accelerometer is a 3-axis accelerometer.

85. The method of claim 1, wherein an output of said at least one other sensor is generated at a sampling rate of 200 samples/second.

86. The method of claim 78, wherein said step of transmitting further comprises:

wirelessly transmitting said data in accordance with Bluetooth®

.

87. The method of claim 1, further comprising:

disposing a plurality of buttons and at least one LED on a housing of said handheld device.

88. The method of claim 1, wherein an output of said at least one other sensor includes position data values.

89. The method of claim 1, wherein said compensating performs said two-dimensional rotational transform on translational motion detected by said at least one other sensor.

90. The method of claim 1, wherein said compensating performs said two-dimensional rotational transform on rotational motion detected by said at least one other sensor.

91. The method of claim 1, wherein said compensating performs said two-dimensional rotational transform on both translational motion and rotational motion detected by said at least one other sensor.

92. The method of claim 1, further comprising:

processing at least one of an output of said accelerometer and an output of said at least one other prior to said compensating.

93. The method of claim 92, wherein said processing prior to said compensating includes compensating said at least one of said output of said accelerometer and said output of said at least one other sensor for offset bias.

94. The method of claim 92, wherein said processing prior to said compensating includes converting said at least one of said output of said accelerometer and said output of said at least one other sensor into different units.

2. A handheld device comprising:

a sensor configured to generate a first output associated with motion of said handheld device;

an accelerometer configured to detect acceleration of said handheld device and outputting at least one second output; and

a processing unit configured to receive and process said first output from said sensor and said at least one second output from said accelerometer,

said process including;

determining an orientation in which said handheld device is held using said at least one second output,

compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of a tilt of said handheld device with reference to a predetermined axis; and

determining a gesture associated with the detected movement.

3. The handheld device of claim 2, wherein said sensor is a camera.

4. The handheld device of claim 2, wherein said sensor is a rotational sensor.

5. The handheld device of claim 2, wherein said sensor is a magnetometer.

6. The handheld device of claim 2, wherein said sensor is an optical sensor.

7. The handheld device of claim 2, wherein said accelerometer is a multi-axis accelerometer and wherein said at least one second output includes a value y generated by said multi-axis accelerometer associated with acceleration of said handheld device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said handheld device in a z-axis direction.

8. The handheld device of claim 7, wherein said multi-axis accelerometer is a 3-axis accelerometer.

9. The handheld device of claim 2, wherein said first output is generated at a sampling rate of 200 samples/second.

10. The handheld device of claim 2, further comprising:

a wireless transceiver for receiving data from said processing unit and wirelessly transmitting said data.

11. The handheld device of claim 10, wherein said wireless transceiver is a Bluetooth®

transceiver.

12. The handheld device of claim 2, further comprising:

a plurality of buttons disposed on a housing of said handheld device; and

at least one LED disposed on said housing.

13. The handheld device of claim 2, wherein said first output includes position data values.

14. The handheld device of claim 2, wherein said processing performs said two dimensional rotational transform on detected translational motion of said handheld device.

15. The handheld device of claim 2, wherein said processing performs said two dimensional rotational transform on detected rotational motion of said handheld device.

16. The handheld device of claim 2, wherein said processing performs said two dimensional rotational transform on both detected translational motion and detected rotational motion of said handheld device.

17. The handheld device of claim 2, wherein said handheld device is a 3D pointing device.

36. The device of claim 2, wherein at least one of said first output and said at least one second output are processed prior to said compensating.

37. The device of claim 36, wherein said processing prior to said compensating includes compensating said at least one of said first output and said at least one second output for offset bias.

38. The device of claim 36, wherein said processing prior to said compensating includes converting said at least one of said first output and said at least one second output into different units.

95. The method of claim 2, wherein said handheld device is a 3D pointing device.

18. A system comprising:

(a) a handheld device including;

a sensor configured to generate a first output associated with motion of said handheld device; and

an accelerometer configured to detect acceleration of said handheld device and outputting at least one second output; and

(b) a processing unit for receiving and processing said first output from said sensor and said at least one second output from said accelerometer, said processing including;

determining an orientation in which said handheld device is held using said at least one second output;

compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of a tilt of said handheld device with reference to a predetermined axis; and

determining a gesture associated with the motion of the handheld device.

19. The system of claim 18, wherein said system further comprises:

a system controller;

a wireless transceiver, disposed in said handheld device, for transmitting data from said handheld device to said system controller;

wherein said processing unit is disposed within one of said handheld device and said system controller.

20. The system of claim 18, wherein said sensor is a camera.

21. The system of claim 18, wherein said sensor is a rotational sensor.

22. The system of claim 18, wherein said sensor is a magnetometer.

23. The system of claim 18, wherein said sensor is an optical sensor.

24. The system of claim 18, wherein said accelerometer is a multi-axis accelerometer and wherein said at least one second output includes a value y generated by said multi-axis accelerometer associated with acceleration of said handheld device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said handheld device in a z-axis direction.

25. The system of claim 24, wherein said multi-axis accelerometer is a 3-axis accelerometer.

26. The system of claim 18, wherein said first output is generated at a sampling rate of 200 samples/second.

27. The system of claim 19, wherein said wireless transceiver is a Bluetooth®

transceiver.

28. The system of claim 18, further comprising:

a plurality of buttons disposed on a housing of said handheld device; and

at least one LED disposed on said housing.

29. The system of claim 18, wherein said first output includes position data values.

30. The system of claim 18, wherein said processing unit performs said two-dimensional rotational transformation on translational motion detected by said sensor.

31. The system of claim 18, wherein said processing unit performs said two-dimensional rotational transform on rotational motion detected by said sensor.

32. The system of claim 18, wherein said processing unit performs said two-dimensional rotational transform on both translational motion and rotational motion detected by said sensor.

33. The system of claim 18, wherein at least one of said first output and said at least one second output are processed prior to said compensating.

34. The system of claim 33, wherein said processing prior to said compensating includes compensating said at least one of said first output and said at least one second output for offset bias.

35. The system of claim 33, wherein said processing prior to compensating includes converting said at least one of said first output and said at least one second output into different units.

39. The system of claim 18, wherein said handheld device is a 3D pointing device.

40. A method comprising:

generating, from a first sensor, a first output associated with motion of a handheld device;

detecting, by a second sensor, acceleration of said handheld device and outputting at least one second output; and

processing said first output and said at least one second output, said processing including;

determining an orientation in which said handheld device is held using said at least one second output;

compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of a tilt of said handheld device with reference to a predetermined axis; and

determining a gesture associated with the motion of the handheld device.

41. The method of claim 40, further comprising:

transmitting data from said handheld device to a system controller, wherein said processing is performed within one of said handheld device and said system controller.

42. The method of claim 40, wherein said first sensor is a camera.

43. The method of claim 40, wherein said first sensor is a rotational sensor.

44. The method of claim 40, wherein said first sensor is a magnetometer.

45. The method of claim 40, wherein said first sensor is an optical sensor.

46. The method of claim 40, wherein said second sensor is a multi-axis accelerometer and wherein said at least one second output includes a value y generated by said multi-axis accelerometer associated with acceleration of said handheld device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said handheld device in a z-axis direction.

47. The method of claim 46, wherein said multi-axis accelerometer is a 3-axis accelerometer.

48. The method of claim 40, wherein said first output is generated at a sampling rate of 200 samples/second.

49. The method of claim 41, wherein said step of transmitting further comprises:

wirelessly transmitting said data in accordance with Bluetooth®

.

50. The method of claim 40, further comprising:

disposing a plurality of buttons and at least one LED on a housing of said handheld device.

51. The method of claim 40, wherein said first output includes position data values.

52. The method of claim 40, wherein said processing performs said two-dimensional rotational transform on translational motion detected by said first sensor.

53. The method of claim 40, wherein said processing performs said two-dimensional rotational transform on rotational motion detected by said first sensor.

54. The method of claim 40, wherein said processing performs said two-dimensional rotational transform on both translational motion and rotational motion detected by said first sensor.

55. The method of claim 40, further comprising:

processing at least one of said first output and said at least one second output prior to said compensating.

56. The method of claim 55, wherein said processing prior to said compensating includes compensating said at least one of said first output and said at least one second output for offset bias.

57. The method of claim 55, wherein said processing prior to said compensating includes converting said at least one of said first output and said at least one second output into different units.

58. The method of claim 40, wherein said handheld device is a 3D pointing device.

59. A system comprising:

means for generating, from a first sensor, a first output associated with motion of a handheld device;

means for detecting, by a second sensor, acceleration of said handheld device and outputting at least one second output; and

means for processing said first output and said at least one second output, said processing means including;

means for determining an orientation in which said handheld device is held using said at least one second output;

means for compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of a tilt of said handheld device with reference to a predetermined axis; and

means for determining a gesture associated with the motion of the handheld device.

60. The system of claim 59, wherein said system further comprises:

means for controlling; and

means for transmitting data, disposed in said handheld device, from said handheld device to said means for controlling,

wherein said means for processing is disposed within one of said handheld device and said means for controlling.

61. The system of claim 59, wherein said first sensor is a camera.

62. The system of claim 59, wherein said first sensor is a rotational sensor.

63. The system of claim 59, wherein said first sensor is a magnetometer.

64. The system of claim 59, wherein said first sensor is an optical sensor.

65. The system of claim 59, wherein said second sensor is a multi-axis accelerometer and wherein said at least one second output includes a value y generated by said multi-axis accelerometer associated with acceleration of said handheld device in a y-axis direction and a value z generated by said multi-axis accelerometer associated with acceleration of said handheld device in a z-axis direction.

66. The system of claim 65, wherein said multi-axis accelerometer is a 3-axis accelerometer.

67. The system of claim 59, wherein said first output is generated at a sampling rate of 200 samples/second.

68. The system of claim 59, wherein said means for transmitting data is a Bluetooth®

transceiver.

69. The system of claim 59, further comprising:

a plurality of buttons disposed on a housing of said handheld device; and

at least one LED disposed on said housing.

70. The system of claim 59, wherein said first output includes position data values.

71. The system of claim 59, wherein said means for processing performs said two-dimensional rotational transformation on translational motion detected by said first sensor.

72. The system of claim 59, wherein said means for processing performs said two-dimensional rotational transform on rotational motion detected by said first sensor.

73. The system of claim 59, wherein said means for processing performs said two-dimensional rotational transform on both translational motion and rotational motion detected by said first sensor.

74. The system of claim 59, wherein at least one of said first output and said at least one second output are processed prior to said compensating.

75. The system of claim 74, wherein said processing prior to said compensating includes compensating said at least one of said first output and said at least one second output for offset bias.

76. The system of claim 74, wherein said processing prior to compensating includes converting said at least one of said first output and said at least one second output into different units.

77. The system of claim 59, wherein said handheld device is a 3D pointing device.