Ultrasonic haptic control system

• US 10,372,270 B2
• Filed: 07/27/2017
• Issued: 08/06/2019
• Est. Priority Date: 08/17/2016
• Status: Expired due to Fees

• Current Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Original Assignee: Ford Global Technologies, LLC (Ford Motor Company)
• Inventors: Hoggarth, Marcus, Dekker, Jasper, Rose, Edward
• Primary Examiner(s): Castiaux, Brent D
• Application Number:
  US15/661,287
• Publication Number:
  US 20180052541A1
• Time in Patent Office: 740 Days
• CPC Class Codes: B60K 2360/141 Activation of instrument input devices by approaching fingers or pens
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/1464 3D-gesture
• CPC Class Codes: B60K 2360/1868 according to driving situations
• CPC Class Codes: B60K 2360/782 on the steering wheel
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/211 producing three-dimensional [3D] effects, e.g. stereoscopic images
• CPC Class Codes: B60K 35/25 using haptic output
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/043 using propagating acoustic waves
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30268 Vehicle interior
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80

Abstract

An ultrasonic haptic control system for a motor vehicle is provided. The system includes a steering wheel assembly comprising a ring-shaped member configured to be held by an occupant of the vehicle, and rotated about a central axis in order to steer the vehicle; and a plurality of ultrasound emitters associated with the steering wheel. The ultrasound emitters are configured to focus ultrasound waves within a central region about which the ring-shaped member circumferentially extends and/or radially outside of and adjacent to the ring-shaped member. The focused ultrasound waves are configured to form one or more haptic control surfaces. A method of operating a haptic control system is also provided.

Claims

1. An ultrasonic haptic control system for a motor vehicle, comprising:

a steering wheel assembly comprising a ring-shaped member rotatable about a central axis to steer the vehicle; and

a plurality of ultrasound emitters associated with the steering wheel and configured to focus ultrasound waves within a central region about which the ring-shaped member circumferentially extends and/or radially outside of and adjacent to the ring-shaped member to form one or more haptic control surfaces, wherein the plurality of ultrasound emitters emit ultrasound waves having a tangential component.

2. The ultrasonic haptic control system of claim 1, wherein one or more of the ultrasound emitters are provided in an array of ultrasound emitters on a trim portion of the vehicle, the array of ultrasound emitters being configured to project ultrasound towards the steering wheel.

3. The ultrasonic haptic control system of claim 1, wherein one or more of the ultrasound emitters are provided on the ring-shaped member.

4. The ultrasonic haptic control system of claim 1, wherein the steering wheel comprises a further ring-shaped member offset from the ring-shaped member along the central axis, wherein one or more of the ultrasound emitters are provided on the further ring-shaped member.

5. The ultrasonic haptic control system of claim 1, wherein the system further comprises a camera configured to capture an image of a hand or fingers of the occupant.

6. The ultrasonic haptic control system of claim 1, wherein the system is configured to determine a position of the occupant'"'"'s hand or fingers relative to locations at which the haptic control surfaces are formed.

7. The ultrasonic haptic control system of claim 6, wherein the system is configured to provide the haptic control surfaces when the occupant'"'"'s hand or fingers are within a threshold distance of the locations at which the haptic control surfaces are formed;

and

wherein the system is configured not to provide the haptic control surfaces when the occupant'"'"'s hand or fingers are not within the threshold distance of the locations.

8. The ultrasonic haptic control system of claim 6, wherein the system is configured to control the operation of the ultrasound emitters to control the position and/or haptic qualities of the haptic control surfaces according to the position of the occupant'"'"'s hand or fingers, and wherein the system is configured to determine a control input based on the position of the occupant'"'"'s hand or fingers.

9. The ultrasonic haptic control system of claim 1, wherein the steering wheel is movable within the vehicle, such that the ring-shaped member central axis is movable between first and second positions, wherein the haptic control system is configured such that the haptic control surfaces remain stationary relative to the ring-shaped member central axis as the ring-shaped member moves.

10. The ultrasonic haptic control system of claim 1, wherein the haptic control system is configured such that one or more of the haptic control surfaces do not rotate as the ring-shaped member rotates about the central axis.

11. The ultrasonic haptic control system of claim 1, wherein the haptic control system is configured such that one or more of the haptic control surfaces rotate together with the ring-shaped member as the ring-shaped member rotates about the central axis.

12. The ultrasonic haptic control system of claim 1, wherein the ultrasound emitters are configured to move together within the ring-shaped member such that the haptic control surfaces remain stationary relative to the ring-shaped member central axis, as the ring-shaped member moves.

13. The ultrasonic haptic control system of claim 1, wherein the steering wheel is movable between a first position and a second position;

wherein the ultrasound emitters are configured to produce the haptic control surfaces when the steering wheel is positioned at or close to the first position; and

wherein the haptic control system comprises a plurality of further ultrasound emitters configured to produce the haptic control surfaces when the steering wheel is positioned at or close to the second position.

14. The ultrasonic haptic control system according to claim 6, wherein the system further comprises a holographic projector configured to produce a holographic image within or adjacent to the ring-shaped member;

wherein the holographic image provides one or more visual representations of controls of the vehicle corresponding to one or more of the haptic control surfaces; and

wherein the holographic projector is configured such that one or more of the visual representations are visible when the occupant'"'"'s hand or fingers are within a threshold distance of the corresponding haptic control surface and are substantially invisible when the occupant'"'"'s hand or fingers are not within the threshold distance of the corresponding haptic control surface.

15. The ultrasonic haptic control system of claim 14, wherein the haptic control surfaces are provided with corresponding visual representations according to a controls setting, and wherein the holographic projector is configured such that the visual representations remain stationary relative to the haptic control surfaces as the ring-shaped member moves.

16. The ultrasonic haptic control system of claim 14, wherein the steering wheel is movable between a first position and a second position;

wherein the holographic projector is configured to produce the visual representations when the steering wheel is positioned at or close to the first position; and

wherein the haptic control system comprises a further holographic projector configured to produce the visual representations when the steering wheel is positioned at or close to the second position.

17. The ultrasonic haptic control system of claim 14, wherein the system further comprises a controller configured to control the operation of the ultrasound emitters to provide the haptic control surfaces, and wherein the controller is further configured to control the operation of the holographic projector.

18. A method of operating a haptic control system for a motor vehicle, comprising:

providing a steering wheel comprising a ring-shaped member configured to be held by an occupant of the vehicle;

providing a plurality of ultrasound emitters associated with the steering wheel; and

focusing ultrasound waves from the ultrasound emitters to produce one or more haptic control surfaces within or adjacent to the ring-shaped member, wherein the plurality of ultrasound emitters emit ultrasound waves having a tangential component.

19. The method of claim 18 further comprising:

capturing an image of a hand or fingers of the occupant;

determining a position of the occupant'"'"'s hand or fingers relative to the haptic control surfaces;

controlling the position and/or haptic qualities of the haptic control surfaces according to the position of the occupant'"'"'s hand or fingers; and

determining a control input based on the position of the occupant'"'"'s hand or fingers.

20. The method of any of claim 18, wherein the system further comprises a holographic projector, and wherein the method further comprises:

projecting a holographic image within or adjacent to the ring-shaped member, the holographic image configured to represent one or more controls of the vehicle; and

adjusting the holographic image to represent a further control corresponding to a haptic control surface when the occupant'"'"'s hand or fingers are within a threshold distance of the haptic control surface.