Hands-free human machine interface responsive to a driver of a vehicle

• US 10,007,112 B2
• Filed: 05/06/2015
• Issued: 06/26/2018
• Est. Priority Date: 05/06/2015
• Status: Active Grant

• Current Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Original Assignee: Hand Held Products Incorporated (Honeywell International Inc.)
• Inventors: Fitch, Timothy R., Smith, Windell, Whitfield, II, Scott D'Wayne, Burwell, Demond, Williams, John Matthew, Gregory, Laran, Anderson, Kyler, Park, Olivia, Dye, Julie
• Primary Examiner(s): Sasinowski, Andrew
• Application Number:
  US14/705,012
• Publication Number:
  US 20160325677A1
• Time in Patent Office: 1,147 Days
• CPC Class Codes: B60R 1/04 mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 2001/1215 with information displays
• CPC Class Codes: B60R 2001/1223 with sensors or transducers
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2001/1276 with radio receivers, loud-speakers or buzzers
• CPC Class Codes: B60R 2001/1284 with communication systems other than radio-receivers, e.g. keyless entry systems, navigation systems; with anti-collision systems
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: G02B 2027/0196 having transparent supporting structure for display mounting, e.g. to a window or a windshield
• CPC Class Codes: G02B 27/0149 characterised by mechanical features G02B27/0176 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Human machine interfaces for use in a vehicle are provided. According to one implementation, a human machine interface (HMI) comprises a housing configured to be mounted on a vehicle. The HMI also includes a sensor, a microphone, and a speaker disposed in the housing. The sensor is configured to sense image input received from a driver of the vehicle. The microphone is configured to receive speech input received from the driver. The speaker is configured to provide audio output to the driver. The HMI further includes a processing device disposed within the housing and coupled with the sensor, microphone, and speaker. The processing device is configured to process the image input and speech input.

Claims

1. A human machine interface comprising:

a housing configured to be mounted inside the cabin of a vehicle, wherein a lower portion of the housing comprises an interface unit;

a gesture sensing device disposed in the housing, the gesture sensing device configured to sense gestures of a driver of the vehicle;

a microphone disposed in the housing, the microphone configured to receive speech input from the driver;

a speaker disposed in the housing, the speaker configured to provide audio output to the driver;

a heads-up display (HUD) projector disposed at a back side of the interface unit, the HUD projector configured to face forwardly to project visual output onto a windshield of the vehicle when the housing is mounted inside the cabin; and

a processing device disposed within the housing and electrically coupled with the gesture sensing device, microphone, speaker, and HUD projector, wherein the processing device is configured to process gesture and speech input received from the driver, wherein the processing device is further configured to generate audio output to be provided to the driver via the speaker and visual output to be provided to the driver via the HUD projector, and wherein the processing device is further configured to align and adjust the visual output provided by the HUD projector based on at least one of shape of the windshield and design of the windshield; and

a mirror disposed on an outside surface of the housing, wherein the mirror is configured to face rearwardly when the housing is mounted inside the cabin, to enable the driver to see behind the vehicle when the driver faces in a forward direction with respect to the vehicle, and wherein the mirror has a lower edge,

wherein the interface unit is positioned beneath, and extends along, the lower edge of the mirror.

2. The human machine interface of claim 1, further comprising a short range wireless communication device disposed in the housing, the short range wireless communication device configured to create a piconet with a mobile device.

3. The human machine interface of claim 1, further comprising a global positioning system (GPS) communication device disposed in the housing, the GPS communication device configured to determine an earth position of the vehicle, the processing device being further configured to execute navigation functions based on the earth position of the vehicle.

4. The human machine interface of claim 1, further comprising:

a forward facing camera disposed in the housing, the forward facing camera configured to detect images in front of the vehicle; and

a rear facing camera disposed in the housing, the rear facing camera configured to detect images behind the vehicle;

wherein the processing device is further configured to execute image combining functions to combine supplemental visual information with images detected by at least one of the forward facing camera and rear facing camera.

5. The human machine interface of claim 1, wherein the interface unit includes at least one of the gesture sensing device, the microphone, the speaker, and the HUD projector.

6. The human machine interface of claim 1, wherein the interface unit includes each of the gesture sensing device, the microphone, the speaker, and the HUD projector.

7. The human machine interface of claim 1, wherein the visual output comprises a plurality of visual information comprising live images from a forward facing camera, potential obstacles, speed of the vehicle, directional instructions, and cellular caller information.

8. The human machine interface of claim 1, wherein:

the visual output comprises a plurality of visual information; and

the processing device is configured to align and adjust the plurality of visual information based on an angle at which the HUD projector is directed to the windshield.

9. A human machine interface comprising:

a housing configured to be mounted on a vehicle, wherein a lower portion of the housing comprises an interface unit;

a sensor disposed in the housing, the sensor configured to sense image input received from a driver of the vehicle;

a microphone disposed in the housing, the microphone configured to receive speech input received from the driver;

a speaker disposed in the housing, the speaker configured to provide audio output to the driver;

a processing device disposed within the housing and coupled with the sensor, microphone, and speaker, the processing device configured to process the image input and speech input, and wherein the processing device is further configured to align and adjust a plurality of processed images on a windshield of the vehicle based on at least one of shape of the windshield and design of the windshield; and

a mirror disposed on an outside surface of the housing, wherein the mirror is configured to face rearwardly when the housing is mounted on the vehicle, to enable the driver to see behind the vehicle when the driver faces in a forward direction with respect to the vehicle, and wherein the mirror has a lower edge,

wherein the interface unit is positioned beneath, and extends along, the lower edge of the mirror.

10. The human machine interface of claim 9, further comprising a heads-up display (HUD) projector disposed in the housing, the HUD projector configured to project the plurality of processed images onto the windshield of the vehicle.

11. The human machine interface of claim 10, wherein the housing is mounted adjacent to a top edge of the windshield.

12. The human machine interface of claim 11, wherein the housing is configured to be mounted inside the cabin of the vehicle, and wherein the vehicle is one of a truck, van, and automobile.

13. The human machine interface of claim 10, wherein the HUD projector is disposed at a back side of the interface unit and positioned to face forwardly to project the plurality of processed images onto the windshield of the vehicle.

14. The human machine interface of claim 10, wherein the processing device is configured to align and adjust the plurality of processed images based on an angle at which the HUD projector is directed to the windshield.

15. The human machine interface of claim 9, wherein the sensor includes at least one camera.

16. The human machine interface of claim 9, wherein the processing device is further configured to execute speech recognition functions to interpret voice commands received from the driver.

17. The human machine interface of claim 9, further comprising a forward facing camera disposed in the housing, the forward facing camera configured to detect images in front of the vehicle.

18. The human machine interface of claim 17, wherein the processing device is further configured to execute image combining functions to combine supplemental visual information with images detected by the forward facing camera.

19. The human machine interface of claim 9, further comprising a rear facing camera disposed in the housing, the rear facing camera configured to detect images behind the vehicle.

20. The human machine interface of claim 9, further comprising a global positioning system (GPS) communication device configured to determine an earth position of the vehicle.

21. The human machine interface of claim 20, wherein the processing device is further configured to execute navigation functions based on the earth position of the vehicle.

22. The human machine interface of claim 9, further comprising a short range wireless communication device configured to create a piconet with a mobile device.

23. The human machine interface of claim 9, further comprising a power source configured to provide electrical power to at least the sensor, microphone, speaker, and processing device.

24. The human machine interface of claim 9, wherein the interface unit includes at least one of the sensor, the microphone, and the speaker.

25. The human machine interface of claim 9, wherein the interface unit includes each of the sensor, the microphone, and the speaker.