Actuator control of adjustable elements by speech localization in a vehicle

• US 8,688,458 B2
• Filed: 02/23/2006
• Issued: 04/01/2014
• Est. Priority Date: 02/23/2005
• Status: Active Grant

• Current Assignee: Harman Becker Automotive Systems GmbH (Samsung Group)
• Original Assignee: Harman Becker Automotive Systems GmbH (Samsung Group), Harman International Industries Incorporated (Samsung Group)
• Inventors: Buck, Markus, Schmidt, Gerhard Uwe, Haulick, Tim
• Primary Examiner(s): Lerner, Martin
• Application Number:
  US11/362,286
• Publication Number:
  US 20070038444A1
• Time in Patent Office: 2,959 Days
• Field of Search: 704/236, 704/270, 704/275, 704/231, 348/169, 381/92
• US Class Current: 704/275
• CPC Class Codes: B60R 16/0373 Voice control in general G10L
• CPC Class Codes: G10L 2021/02165 Two microphones, one receiving mainly the noise signal and the other one mainly the speech signal

Abstract

An approach for adjusting an adjustable element, such as a mirror, head rest, steering wheel, heating/air condition blower, associated with a vehicle by determining the position of a speaker in the vehicle.

Claims

1. A system for adjusting an adjustable element associated with a vehicle, the system-comprising:

an actuator adapted to adjust the adjustable element;

at least one microphone array for detecting speech from a speaker within the vehicle and generating speech signals corresponding to the detected speech;

a localization detector configured to determine a position of the speaker based on the speech signals and configured to output a localization signal that encodes the determined position of the speaker;

a speech recognition system configured to receive the speech signals and output a command signal based on content of the speech signals; and

a controller for controlling the actuator, the controller adapted to receive the localization signal and the command signal and to control the actuator to adjust the state of the adjustable element on the basis of the determined position of the speaker encoded in the localization signal and the command signal, where the controller is configured to operate the actuator in response to a change in the position of the speaker being greater than a predetermined amount.

2. The system of claim 1, further comprising a beamformer configured to receive the speech signals and the localization signal, and to generate beamformed signals from the voice signals, where the beamformed signals exhibit a preference for voice signals in a direction determined by the localization signal, and where the speech recognition system is configured to receive the beamformed signals and output the command signal to the controller based on the beamformed signals.

3. The system of claim 2, where the localization detector is configured to calculate a confidence value relating to positional accuracy of localization of the speaker, and compare the confidence value to a predetermined confidence threshold such that the localization detector transmits a localization failure signal to the speech recognition system if the confidence value is below the predetermined confidence threshold.

4. The system of claim 3, where the speech recognition system is configured to output a repeat command prompt to the speaker when the speech recognition system receives a localization failure signal.

5. The system of claim 1, where the speech recognition system is configured to also receive the localization signal and to output the command signal based on the localization signal and the content of the speech signals.

6. The system of claim 1, further comprising a sensor, the controller being configured to receive a sensor output signal and to control the actuator associated with the adjustable element based on the received sensor output signal.

7. The system of claim 6, where the sensor comprises a daylight sensor.

8. The system of claim 1, further comprising a manual re-adjustment mechanism for re-adjusting the adjustable element by the speaker.

9. The system of claim 1, where the at least one microphone array includes at least one of a one-dimensional, two-dimensional, and three-dimensional assembly of microphones.

10. The system of claim 9, where the at least one microphone array includes a directional microphone.

11. The system of claim 9, where the at least one microphone array includes a plurality of directional microphones oriented in different directions.

12. The system of claim 1, where the adjustable element comprises at least one of an interior mirror;

an exterior mirror;

a head rest;

an arm rest;

a steering wheel/steering column;

a heating/air conditioning blower;

a display;

an on-board navigation system; and

a loudspeaker.

13. A method of adjusting an adjustable element associated with a vehicle, the adjustable element including an actuator for adjusting the adjustable element, the method comprising:

providing at least one microphone array;

detecting speech emanating from a first person by the at least one microphone array such that the at least one microphone array produces voice signals corresponding to the detected speech;

determining a position of the first person based on the voice signals;

encoding the determined position of the first person in a localization signal;

providing a speech recognition system adapted to recognize speech input commands uttered by the first person;

determining which adjustable element of a plurality of adjustable elements is to be adjusted based on the received input command; and

controlling the actuator of the adjustable element to adjust the adjustable element to a position commensurate with the determined position of the first person encoded in the localization signal, the adjustable element adjusted in response to a change in the position of the first person being greater than a predetermined amount.

14. The method of claim 13, further comprising beamforming the microphone signals detected by the at least one microphone array and providing the beamformed microphone signals to the speech recognition system.

15. The method of claim 13, further comprising:

calculating a confidence value relating to accuracy of the determination of the position of the first person;

comparing the confidence value to a predefined confidence threshold; and

generating a repeat command prompt when it is determined that the confidence value is below the predefined confidence threshold.

16. The method of claim 13, where the speech recognition system is adapted to receive localization information regarding the position of the person and to transmit the localization information to a controller that controls the actuator of the adjustable element to be adjusted.

17. The method of claim 13, where the actuator associated with the adjustable element is further controlled on the basis of data obtained by a sensor.

18. The method of claim 17, where the sensor is a daylight detecting sensor.

19. The method of claim 13, where the adjustable element is adapted to be manually re-adjusted.

20. The method of claim 13, where the position of the person is determined on a basis of microphone signals detected by the at least one microphone array comprising at least one of a one-dimensional, two-dimensional, or three-dimensional microphone array.

21. The method of claim 20, where the at least one microphone array includes a directional microphone.

22. The method of claim 20, where the at least one microphone array includes a plurality of directional microphones oriented in different directions.

23. The method of claim 13, where the adjustable element comprises at least one of:

an interior mirror;

an exterior mirror;

a head rest;

an arm rest;

steering wheel/steering column;

a heater/air conditioner blower;

a display;

an on-board navigation system; and

a loudspeaker.