Steering wheel input device having gesture recognition and angle compensation capabilities

• US 9,389,695 B2
• Filed: 11/06/2014
• Issued: 07/12/2016
• Est. Priority Date: 07/22/2011
• Status: Active Grant

• Current Assignee: AmZetta Technologies, LLC (American Megatrends International, LLC)
• Original Assignee: American Megatrends Incorporated
• Inventors: Sivertsen, Clas G.
• Primary Examiner(s): TRAN, HANH VAN
• Application Number:
  US14/534,936
• Publication Number:
  US 20150066294A1
• Time in Patent Office: 614 Days
• Field of Search: 701/36, 701/41, 715/863, 345/156, 345173-178, 178/18.01, 178/18.03
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/782 on the steering wheel
• CPC Class Codes: B60K 2370/143 Touch sensitive input devices
• CPC Class Codes: B60K 2370/146 Input by gesture
• CPC Class Codes: B60K 2370/782 on the steering wheel
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B62D 1/04 Hand wheels
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Abstract

A steering wheel input device is mounted on a vehicle steering wheel and includes a pointer detection device detecting a pointer event on a pointer detection surface, any movement or breaking of the pointer event, and the speed, velocity, and acceleration of the pointer event, and outputs a corresponding pointer detection signal. The steering wheel input device also includes a rotation angle sensor and a processor. The rotation angle sensor takes measurements related to an angle of rotation of the steering wheel and outputs a corresponding rotation detection signal. The processor determines the angle of rotation of the steering wheel using the rotation detection signal, determines which gesture that the pointer detection signal corresponds to using the pointer detection signal and the angle of rotation of the steering wheel, and outputs a command corresponding to the gesture. The command can serve as input to control vehicular systems.

Claims

1. A steering wheel input device mounted on a steering wheel of a vehicle, comprising:

a pointer detection device comprising a pointer detection surface and an input detection unit, wherein the input detection unit is configured to detect on the pointer detection surface a single pointer event or multiple simultaneous pointer events, a movement or breaking of the pointer event, and a speed, velocity, and acceleration of the single pointer event or the multiple simultaneous pointer events, wherein the input detection unit is configured to output in response to a corresponding pointer detection signal;

a rotation angle sensor comprising an accelerometer configured to take a measurement related to an angle of rotation of the steering wheel and to output at least one corresponding rotation detection signal based on the angle of rotation measured; and

a processor configured to

determine the angle of rotation of the steering wheel with reference to the at least one corresponding rotation detection signal output by the rotation angle sensor,

determine a gesture provided as input from a user from among a plurality of gestures that the pointer detection signal corresponds to with reference to the pointer detection signal and the angle of rotation of the steering wheel, and

output a command corresponding to the gesture to a device in the vehicle.

2. The steering wheel input device of claim 1, further comprising

a gyroscope configured to take measurements related to the angle of rotation of the steering wheel and to output a second rotation detection signal, wherein the processor is further configured to determine the angle of rotation of the steering wheel with reference to a first rotation detection signal and a second rotation detection signal.

3. The steering wheel input device of claim 1, wherein the processor is programmable by the user to designate the plurality of gestures and to associate commands with the designated gestures.

4. The steering wheel input device of claim 1, wherein the processor is configured to apply a rule to select the gesture when two gestures potentially correspond to the pointer detection signal.

5. The steering wheel input device of claim 4, wherein in response to at least one learning condition comprising the user inputting a cancellation gesture to cancel the gesture selected by the processor, the processor is further configured to change the rule so that the other of the two gestures is selected in a subsequent selection between the two gestures.

6. The steering wheel input device of claim 5, wherein the at least one learning condition further comprises the steering wheel being within a predetermined range of the angle of rotation.

7. The steering wheel input device of claim 1, wherein:

the pointer detection surface of the pointer detection device is part of a touchscreen or a proximity sensing display capable of displaying visual output; and

the processor is linked to the device of the vehicle and is further configured to output information for display of a state of the device on the pointer detection surface.

8. The steering wheel input device of claim 1, wherein:

the rotation angle sensor is further configured to take measurements related to a tilt angle of the steering wheel during a calibration period and to output a corresponding steering wheel tilt angle signal; and

the processor is further configured to determine the tilt angle of the steering wheel using the tilt angle signal, and to determine the angle of rotation of the steering wheel with reference to the at least one rotation detection signal and further with reference to the tilt angle of the steering wheel.

9. The steering wheel input device of claim 8, further comprising a calibration button, wherein the calibration period is initiated by user manipulation of the calibration button.

10. The steering wheel input device of claim 1, wherein the pointer detection surface comprises a touch-sensitive surface, and the pointer event detected by the input detection unit is a contact on the touch-sensitive surface by a finger of the user.

11. The steering wheel input device of claim 1, wherein the pointer detection surface comprises a proximity-sensitive surface, and the pointer event detected by the input detection unit is the presence of at least one target in proximity to the proximity-sensitive surface.

12. The steering wheel input device of claim 1, wherein the pointer detection surface is mounted on an outer ring of the steering wheel, and comprises a first detection surface and a second detection surface, the first detection surface being angularly displaced from the second detection surface on the outer ring of the steering wheel.

13. The steering wheel input device of claim 1, wherein:

the rotation angle sensor is configured to take measurements related to a changing angle of rotation of the steering wheel and to output a corresponding changing rotation detection signal; and

the processor is configured to determine the changing angle of rotation of the steering wheel with reference to the changing rotation detection signal, and to determine the gesture among the plurality of gestures that the pointer detection signal corresponds to with reference to the pointer detection signal and the changing angle of rotation of the steering wheel.

14. A method, comprising:

detecting on a pointer detection surface of a steering wheel input device

a single pointer event or multiple simultaneous pointer events,

a movement or breaking of the pointer event on the pointer detection surface, and

a speed, velocity, and acceleration of the single pointer event or the multiple simultaneous pointer events on the pointer detection surface,

and generating in response thereto a corresponding pointer detection signal;

taking measurements related to an angle of rotation of the steering wheel and generating at least one corresponding rotation detection signal based on the angle of rotation measured by an accelerometer;

determining the angle of rotation of the steering wheel with reference to the at least one corresponding rotation detection signal;

determining a gesture among a plurality of gestures that the pointer detection signal corresponds to with reference to the pointer detection signal and the angle of rotation of the steering wheel; and

outputting a command corresponding to the gesture to an appropriate device of the vehicle.

15. The method of claim 14, wherein the at least one corresponding rotation detection signal comprises a first rotation detection signal generated by the accelerometer and a second rotation detection signal generated by a gyroscope, and the angle of rotation of the steering wheel is determined with reference to the first rotation detection signal and the second rotation detection signal.

16. The method of claim 14, wherein the command is wirelessly output to the appropriate device of the vehicle through a wireless transmitter device.

17. The method of claim 14, further comprising applying a rule to select the gesture when two gestures potentially correspond to the pointer detection signal.

18. The method of claim 17, wherein in response to a learning condition comprising the user inputting a cancellation gesture to cancel the determined gesture, changing the rule so that the other of the two gestures is selected in a subsequent selection between the two gestures.

19. The method of claim 18, wherein the at least one learning condition further comprises the steering wheel being within a predetermined range of the angle of rotation when selecting between the two gestures using the rule prior to receiving the second gesture.

20. The method of claim 14, further comprising:

taking measurements related to a tilt angle of the steering wheel during a calibration period and generating a corresponding steering wheel tilt angle signal; and

determining the tilt angle of the steering wheel using the tilt angle signal,

wherein the angle of rotation of the steering wheel is determined with reference to the at least one rotation detection signal and further with reference to the tilt angle of the steering wheel.

21. The method of claim 14, further comprising:

taking measurements related to a changing angle of rotation of the steering wheel and generating a corresponding changing rotation detection signal;

determining the changing angle of rotation of the steering wheel with reference to the changing rotation detection signal; and

determining a gesture among a plurality of gestures that the pointer detection signal corresponds to with reference to the pointer detection signal and the changing angle of rotation of the steering wheel.

22. A steering wheel input device of a vehicle comprising:

a touch input detection unit having a surface configured to detect a gesture input of a driver, the gesture input comprising a movement of a finger of the driver on the surface of the touch input detection unit, the touch input detection unit providing in response to detecting the gesture input a corresponding touch detection signal;

a rotation angle sensor comprising an accelerometer configured to take a measurement related to an angle of rotation of the steering wheel and to output at least one corresponding rotation detection signal based on the angle of rotation measured; and

a processor configured to

receive the corresponding touch detection signal,

receive the corresponding rotation angle signal,

determine the gesture input provided as input from the driver based on the corresponding touch detection signal and the corresponding rotation angle signal, and

output a command corresponding to the gesture input to a device in the vehicle.

23. The steering wheel input device of claim 22 wherein the gesture input is an audio control indication and the device is an audio system in the vehicle.

24. The steering wheel input device of claim 23, wherein the gesture input is to increase the volume of the audio system.

25. The steering wheel input device of claim 24, wherein the touch input detection unit having a surface is positioned in a center area of the steering wheel.