Hand-held wireless electronic device with accelerometer for interacting with a display

• US 9,317,108 B2
• Filed: 10/15/2012
• Issued: 04/19/2016
• Est. Priority Date: 11/02/2004
• Status: Expired due to Fees

• Current Assignee: Pierre A. Touma
• Original Assignee: Pierre A. Touma
• Inventors: Touma, Pierre A., Murr, Hadi, Maalouf, Imad, Bachaalani, Elias
• Primary Examiner(s): Spar, Ilana
• Assistant Examiner(s): Steinberg, Jeffrey S
• Application Number:
  US13/573,945
• Publication Number:
  US 20140104156A1
• Time in Patent Office: 1,282 Days
• Field of Search: 345/156, 345/158, 345/168, 345/169
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

A device and method for interacting with a display using an accelerometer sensitive to tilt about two perpendicular axes and a third signal having a magnitude responsive to user input. The device and method allow a user to change a characteristic of an object on the display by converting pitch information, roll information, and a linear dimension into Cartesian coordinates for use by the display.

Claims

1. A hand-held wireless electronic device for interacting with a display, the device comprising:

a MEMS accelerometer responsive to tilt of the device in a plurality of axes wherein;

the accelerometer comprises an integrated circuit that generates a digital tilt signal responsive to the projection of static gravity on the tilted accelerometer;

the accelerometer is most sensitive to tilt when the accelerometer is perpendicular to gravity; and

the digital tilt signal comprises an accelerometer pitch signal and an accelerometer roll signal where pitch and roll are rotations about two perpendicular axes orthogonal to the gravitational vector;

a sliding user input element that generates sliding input electrical signal having a magnitude responsive to a user-imparted sliding motion on the hand-held device, wherein the sliding user input element does not comprise an accelerometer;

a digital electronic circuit connected to the accelerometer and connected to the sliding user input element wherein the circuit;

calculates accelerometer pitch information using an inverse trigonometric function in response to said accelerometer pitch signal;

calculates accelerometer roll information using an inverse trigonometric function in response to said accelerometer roll signal;

calculates line magnitude information in response to the sliding input electrical signal;

calculates a display vector orientation in response to the accelerometer pitch information and the accelerometer roll information without using a signal from a gyroscope;

calculates a display vector length in response to the line magnitude information; and

calculates yaw information;

a communications module electrically coupled to the electronic circuit wherein;

the communications module communicates the display vector orientation to a receiving element of the display;

the communications module communicates the display vector length to a receiving element of the display;

the communications module communicates the yaw information to a receiving element of the display; and

the communications module further comprises a wireless communications element using a digital serial data transmission signal;

a battery that powers the accelerometer, the sliding user input element, the digital electronic circuit and the communications module; and

a circuit that manages the battery and optimizes power consumption for the device.

2. The hand-held wireless electronic device of claim 1 wherein:

said inverse trigonometric functions used to calculate the accelerometer pitch information and the accelerometer roll information on the hand-held wireless device comprises arcsin functions;

the calculation of the display vector orientation and the display vector length from the accelerometer pitch information, the accelerometer roll information, and the sliding input electrical signal further comprises;

a calculation of a spherical vector orientation in a 3-dimensional spherical coordinate system in response to the accelerometer pitch information and the accelerometer roll information without using a signal from a gyroscope;

a calculation of a spherical vector length in the 3-dimensional spherical coordinate system in response to the line magnitude information without using a signal from a gyroscope; and

a coordinate system transformation from the 3-dimensional spherical coordinate system to a 3-dimensional Cartesian coordinate system using Euler angles wherein;

a first Euler angle is responsive to the accelerometer pitch information;

a second Euler angle is responsive to the accelerometer roll information; and

the coordinate system transformation uses a radius measurement responsive to the line magnitude information from the sliding user input element.

3. The hand-held wireless electronic device of claim 2 wherein:

the arcsin function further comprises calculation of the accelerometer pitch information and calculation of the accelerometer roll information from the tilt angles according to the following equations

4. The device of claim 1 wherein the device further comprises the display screen.

5. The device of claim 1 wherein the device comprises a wearable glove.

6. The device of claim 1 wherein:

the digital serial communications protocol used by the wireless communications element of the hand-held wireless device;

is selected from the group of Bluetooth and WiFi; and

is configured for transmitting the display vector orientation, the display vector length, and the yaw information to the display using the digital serial communications protocol

the display is an external 2-dimensional display not located on the hand-held device; and

the sliding input element is a virtual slide switch;

the magnitude of the sliding input electrical signal is responsive to the time the virtual slide switch is turned on.

7. The device of claim 1 wherein:

an input selected from the group of the display vector orientation and the display vector length is used to determine a characteristic of an object presented on the display selected from the group of a field of view rotation, an object rotation, an object size, and an object color; and

the digital serial communications protocol used by the wireless communications element further comprises communication of said object characteristic.

8. The device of claim 1 wherein said sliding user input element comprises a virtual sliding user input element.

9. The device of claim 1 wherein:

the device further comprises a second user input element wherein the second user input element is responsive to a translation motion of at least part of the device;

the digital electronic circuit is connected to the second user input element;

the digital electronic circuit calculates display vector location information in response to the second user input element; and

the communication module communicates the display vector location information to the display.

10. The device of claim 1 wherein:

the device further comprises a second user input element;

the second user input element generates a yaw signal in response to a rotation of at least part of the device;

the digital electronic circuit is connected to the second user input element;

the digital electronic circuit generates field of view rotation information in response to the yaw information, wherein the field of view rotation information comprises a rotation of a virtual scene on the display in a horizontal plane; and

the communication module communicates the field of view rotation information to the display.

11. The device of claim 1 wherein:

the sliding user input element is a physical sliding user input element;

the device further comprises an inertial sensor that generates a yaw signal about an axis substantially aligned with the gravitational acceleration vector and wherein said inertial sensor comprises a gyroscope;

the display is a stereographic display; and

the display is external to the device.

12. The device of claim 11 wherein said inertial sensor comprises a gyroscope based on MEMS technology and wherein the yaw output of the gyroscope is configured to change a characteristic of an object presented on the display selected from the group of a field of view rotation, an object rotation, an object size, and an object color.

13. A portable device for manipulating a pointer in Cartesian space on a two-dimensional display, the device comprising:

an accelerometer responsive to tilt of the device in a plurality of axes wherein;

the accelerometer comprises a circuit that generates a tilt signal responsive to the projection of static gravity on the tilted accelerometer;

the accelerometer is most sensitive to tilt when the accelerometer is perpendicular to gravity; and

the tilt signal comprises an accelerometer pitch signal and an accelerometer roll signal where pitch and roll are rotations about two perpendicular axes orthogonal to the gravitational vector and wherein the accelerometer pitch signal and the accelerometer roll signal are generated without using a sensor responsive to a gyroscopic effect;

an input element on the device that generates a sliding input electrical signal having a magnitude responsive to a sliding input from a user;

an electronic circuit connected to the accelerometer and connected to the input element wherein the circuit;

comprises a control unit, a memory unit, a communications unit, and a battery, wherein the control unit further comprises a micro-controller and a machine-readable storage device;

calculates pitch information using an inverse trigonometric function in response to said accelerometer pitch signal without input from a sensor that operates based on a gyroscopic effect;

calculates roll information using an inverse trigonometric function in response to said accelerometer roll signal without input from a sensor that operates based on a gyroscopic effect;

calculates length information in response to the sliding input electrical signal from the input element; and

calculates the orientation and the length of the pointer in an inertial reference frame in Cartesian coordinates in response to said length information, said pitch information, and said roll information;

a communications module electrically coupled to the electronic circuit which generates a digital signal responsive to said pitch information, said roll information, and said length information wherein;

the digital signal is transmitted electronically to a receiving element connected to the display; and

the digital signal can be used by circuitry coupled to the display to manipulate the pointer on the display.

14. The device of claim 13 wherein:

the communications module further generates a wireless digital serial near field communications protocol; and

the device is a wearable device selected from the group of a glove, a bracelet, a watch, and a shoe.

15. The device of claim 13 wherein:

the electronic circuit further calculates a yaw signal;

the yaw signal is calculated from user input from a device selected from the group of a pair of control buttons, a pair of triggers, a slide switch, a touch pad, and a scroll wheel; and

yaw signal calculation does not comprise input from a device selected from the group of a gyroscope and a magnetic sensor

the device further comprises the display screen; and

the yaw signal is configured to horizontally rotate the field of view on the screen of the display.

16. A method for presenting user manipulation of a portable device onto a display, the method comprising the steps of:

establishing the portable device;

establishing a rotational sensor in the portable device that generates tilt signals responsive to a gravitational vector in the device wherein the rotational sensor comprises a MEMS rotational accelerometer;

measuring pitch and roll about two perpendicular axes orthogonal to the gravitational vector in response to the projection of static gravity on the tilted MEMS rotational accelerometer;

establishing a sliding user input element on the device that generates a sliding input signal in response to a sliding motion by a user wherein the sliding user input element does not comprise a device selected from the group of an accelerometer and a gyroscope;

using the sliding input element to generate a sliding input electrical signal of a magnitude controlled by the user;

establishing an electronic circuit that comprises a control unit, a memory unit, and a communications unit, and an electrical storage device, wherein the control unit further comprises a micro-controller;

connecting the circuit to the rotational sensor;

connecting the circuit to the sliding input element;

using the circuit to calculate pitch and roll from the tilt signals measured by the MEMS rotational accelerometer in the portable device, where pitch and roll further determine a vector orientation;

determining a vector length in response to the sliding input electrical signal;

establishing a display that shows objects in a minimum of two dimensions;

showing a graphical object on the display wherein the size of the graphical object is responsive to the vector length and the orientation of the graphical object is responsive to the vector orientation;

establishing a battery to power the portable device; and

establishing a circuit that manages the battery.

17. The method of claim 16 wherein:

establishing a portable electronic device further comprises an electronic device selected from the group of a wearable device and a hand-held device; and

establishing a display further comprises establishing a display screen on the portable electronic device.

18. The method of claim 16 wherein:

determining the vector orientation further comprises determining the vector orientation in a 3-dimensional spherical coordinate system in response to pitch and roll signals by using arcsin functions;

showing the graphical object on the display further comprises showing the graphical object by using Cartesian coordinates;

using Cartesian coordinates further comprises using Euler angles; and

using Euler angles further comprises using the following three Euler equations;

X=R(t)·

Cos(α

)·

Sin(β

)

Y=R(t)·

Sin(α

)·

Sin(β

)

Z=R(t)·

Cos(β

)

wherein X, Y, and Z represent a location in a Cartesian coordinate domain presented on the display wherein X, Y and Z also have the same origin as a spherical coordinate domain defined by the vector length R(t) responsive to the sliding input signal, α

is an angle representing the longitudinal relationship between R(t) and the ZX plane in the Cartesian coordinates that is responsive to the accelerometer pitch information, and β

is an angle representing the colatitudinal relationship between R(t) and the Z axis that is responsive to the accelerometer roll information.

19. The method of claim 16 further comprising the steps of:

establishing a second user input element wherein the second user input element comprises a pair of push button triggers;

connecting the digital electronic circuit to the second user input element;

calculating field of view information in the electronic circuit in response to the second user input element, wherein the field of view information comprises information selected from the group of field of view translation information, field of view rotation information, and field of view size information; and

communicating the field of view information to the display.

20. The method of claim 16 further comprising the steps of:

simulating a vector yaw in response to the accelerometer pitch, the accelerometer roll, and the sliding input element without using any additional sensing element.