Steering wheel input device having gesture recognition and angle compensation capabilities

• US 8,886,407 B2
• Filed: 07/22/2011
• Issued: 11/11/2014
• Est. Priority Date: 07/22/2011
• Status: Active Grant

• Current Assignee: AmZetta Technologies, LLC (American Megatrends International, LLC)
• Original Assignee: American Megatrends Incorporated
• Inventors: Sivertsen, Clas
• Primary Examiner(s): TRAN, HANH VAN
• Application Number:
  US13/188,975
• Publication Number:
  US 20130024071A1
• Time in Patent Office: 1,208 Days
• Field of Search: 701/36, 701/41, 715/863, 345/156, 345173-178, 178/18.01, 178/18.03
• US Class Current: 701/41
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/782 on the steering wheel
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B62D 1/04 Hand wheels
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Abstract

A steering wheel input device is mounted on a vehicle steering wheel and includes a pointer detection device detecting a pointer event on a pointer detection surface, any movement or breaking of the pointer event, and the speed, velocity, and acceleration of the pointer event, and outputs a corresponding pointer detection signal. The steering wheel input device also includes a rotation angle sensor and a processor. The rotation angle sensor takes measurements related to an angle of rotation of the steering wheel and outputs a corresponding rotation detection signal. The processor determines the angle of rotation of the steering wheel using the rotation detection signal, determines which gesture that the pointer detection signal corresponds to using the pointer detection signal and the angle of rotation of the steering wheel, and outputs a command corresponding to the gesture. The command can serve as input to control vehicular systems.

Claims

1. A steering wheel input device mounted on a steering wheel of a vehicle, comprising:

a pointer detection device comprising a pointer detection surface and an input detection unit, wherein the input detection unit is configured to detect on the pointer detection surface one of a single pointer event or multiple simultaneous pointer events, a movement or breaking of the pointer event, and a speed, velocity, and acceleration of the pointer event, wherein the input detection unit is configured to output in response, to a corresponding pointer detection signal;

a rotation angle sensor configured to measure an angle of rotation of the steering wheel and to output at least one corresponding rotation detection signal; and

a processor configured to

determine the angle of rotation of the steering wheel with reference to the at least one corresponding rotation detection signal output by the rotation angle sensor,

determine a gesture provided as input from a user from among a plurality of gestures that the pointer detection signal corresponds to with reference to the pointer detection signal and the angle of rotation of the steering wheel,

output a command corresponding to the gesture to a device in the vehicle, and

apply a rule to select the gesture when at least two gestures of the plurality of gestures potentially correspond to the pointer detection signal, wherein in response to at least one learning condition comprising the user inputting a second gesture to cancel the gesture selected by the processor, the processor is configured to change the rule so that a different gesture is selected in a subsequent selection between the at least two gestures of the plurality of gestures.

2. The steering wheel input device of claim 1, wherein the rotation angle sensor comprises

an accelerometer configured to take a measurement related to the angle of rotation of the steering wheel and to output a first rotation detection signal of the at least one corresponding rotation detection signal, and the processor is configured to determine the angle of rotation of the steering wheel with reference to the first rotation detection signal of the at least one corresponding rotation detection signal.

3. The steering wheel input device of claim 2, wherein the rotation angle sensor comprises

a gyroscope configured to take measurements related to the angle of rotation of the steering wheel and to output a second rotation detection signal of the at least one corresponding rotation detection signal, the processor being configured to determine the angle of rotation of the steering wheel with reference to the first rotation detection signal and the second rotation detection signal of the at least one corresponding rotation detection signal.

4. The steering wheel input device of claim 1, wherein the processor is programmable by the user to designate the plurality of gestures and to associate commands with the designated gestures.

5. The steering wheel input device of claim 1, wherein the at least one learning condition further comprises the steering wheel being within a predetermined range of the angle of rotation as when the processor selected the gesture using the rule prior to receiving the second gesture.

6. The steering wheel input device of claim 1, wherein:

the pointer detection surface of the pointer detection device is part of a touchscreen or a proximity sensing display capable of displaying visual output; and

the processor is linked to the device of the vehicle and is further configured to output information for display of a state of the device on the pointer detection surface.

7. The steering wheel input device of claim 1, wherein:

the rotation angle sensor is further configured to take measurements related to a tilt angle of the steering wheel during a calibration period and to output a corresponding steering wheel tilt angle signal; and

the processor is further configured to determine the tilt angle of the steering wheel using the tilt angle signal, and to determine the angle of rotation of the steering wheel with reference to the at least one rotation detection signal and further with reference to the tilt angle of the steering wheel.

8. The steering wheel input device of claim 7, further comprising a calibration button, wherein the calibration period is initiated by user manipulation of the calibration button.

9. The steering wheel input device of claim 1, wherein the pointer detection surface comprises a touch-sensitive surface, and the pointer event detected by the input detection unit is a contact on the touch-sensitive surface by a finger of the user.

10. The steering wheel input device of claim 1, wherein the pointer detection surface comprises a proximity-sensitive surface, and the pointer event detected by the input detection unit is the presence of at least one target in proximity to the proximity-sensitive surface.

11. The steering wheel input device of claim 1, wherein the pointer detection surface is mounted on an outer ring of the steering wheel, and comprises a first detection surface and a second detection surface, the first detection surface being angularly displaced from the second detection surface on the outer ring of the steering wheel.

12. The steering wheel input device of claim 1, wherein:

the rotation angle sensor is configured to take measurements related to a changing angle of rotation of the steering wheel and to output a corresponding changing rotation detection signal; and

the processor is configured to determine the changing angle of rotation of the steering wheel with reference to the changing rotation detection signal, and to determine the gesture among the plurality of gestures that the pointer detection signal corresponds to with reference to the pointer detection signal and the changing angle of rotation of the steering wheel.

13. A method for operating a steering wheel input device, comprising:

detecting on a pointer detection surface of the steering wheel input device one of

a single pointer event or multiple simultaneous pointer events,

a movement or breaking of the pointer event on the pointer detection surface, and

a speed, velocity, and acceleration of the single pointer event or multiple simultaneous pointer events on the pointer detection surface,

and generating in response thereto a corresponding pointer detection signal;

taking measurements related to an angle of rotation of the steering wheel and generating at least one corresponding rotation detection signal;

determining the angle of rotation of the steering wheel with reference to the at least one corresponding rotation detection signal;

determining a gesture among a plurality of gestures that the pointer detection signal corresponds to with reference to the pointer detection signal and the angle of rotation of the steering wheel;

outputting a command corresponding to the gesture to an appropriate device of the vehicle,

applying a rule to select the gesture when at least two gestures of the plurality of gestures potentially correspond to the pointer detection signal, and

in response to a learning condition comprising the user inputting a second gesture to cancel the gesture, changing the rule so that a different gesture is selected in a subsequent selection between the at least two gestures of the plurality of gestures.

14. The method of claim 13, wherein the at least one corresponding rotation detection signal comprises a first rotation detection signal generated by an accelerometer and a second rotation detection signal generated by a gyroscope, and the angle of rotation of the steering wheel is determined with reference to the first rotation detection signal and the second rotation detection signal.

15. The method of claim 13, wherein the command is wirelessly output to the appropriate device of the vehicle through a wireless transmitter device.

16. The method of claim 13, wherein the at least one learning condition further comprises the steering wheel being within a predetermined range of the angle of rotation when the processor selects between the two gestures using the rule prior to receiving the second gesture.

17. The method of claim 13, further comprising:

taking measurements related to a tilt angle of the steering wheel during a calibration period and generating a corresponding steering wheel tilt angle signal; and

determining the tilt angle of the steering wheel using the tilt angle signal,

wherein the angle of rotation of the steering wheel is determined with reference to the at least one rotation detection signal and further with reference to the tilt angle of the steering wheel.

18. The method of claim 13, further comprising:

taking measurements related to a changing angle of rotation of the steering wheel and generating a corresponding changing rotation detection signal;

determining the changing angle of rotation of the steering wheel with reference to the changing rotation detection signal; and

determining the gesture among the plurality of gestures that the pointer detection signal corresponds to with reference to the pointer detection signal and the changing angle of rotation of the steering wheel.

19. A steering wheel input device of a vehicle comprising:

a touch input detection unit having a surface configured to detect a gesture input of a driver, the gesture input comprising a movement of a finger of the driver on the surface of the touch input detection unit and a speed, velocity, and acceleration of the finger on the surface of the touch input detection unit, the touch input detection unit providing in response to detecting the gesture input a corresponding touch detection signal;

a rotation angle sensor configured to measure an angle of rotation of a steering wheel and to output a corresponding rotation angle signal; and

a processor configured to

receive the corresponding touch detection signal,

receive the corresponding rotation angle signal,

determine the gesture input provided as input from the driver based on the corresponding touch detection signal and the corresponding rotation angle signal,

output a command corresponding to the gesture input to a device in the vehicle, and

apply a rule to select the gesture input when at least two gestures potentially correspond to a pointer detection signal, wherein in response to at least one learning condition comprising a second gesture input to cancel the gesture input determined by the processor, the processor is configured to change the rule so that a different gesture input is selected in a subsequent selection between the at least two gestures.

20. The steering wheel input device of claim 19, wherein the gesture input is an audio control indication and the device is an audio system in the vehicle.

21. The steering wheel input device of claim 20, wherein the gesture input is to increase the volume of the audio system.

22. The steering wheel input device of claim 21, wherein the touch input detection unit having a surface is positioned in a center area of the steering wheel.