User interface for telematics systems

• US 6,968,311 B2
• Filed: 07/30/2001
• Issued: 11/22/2005
• Est. Priority Date: 07/28/2000
• Status: Expired due to Term

• Current Assignee: Continental Automotive Systems, Inc. (Continental AG)
• Original Assignee: Siemens VDO Automotive Corporation (Siemens AG)
• Inventors: Rode, Melvin A., Delgiudice, Gregory, Knockeart, Ronald P.
• Primary Examiner(s): Lerner, Martin
• Application Number:
  US09/918,360
• Publication Number:
  US 20020069071A1
• Time in Patent Office: 1,576 Days
• Field of Search: 704/270, 704/270.1, 704/275, 455/345, 379/39
• US Class Current: 704/270
• CPC Class Codes: G06F 3/023 Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A combination of manual and voice input for a telematics system reduces visual distraction, works reliably, and is low cost. The telematics system uses a menu-based interface to communicate with the driver. This menu-based interface is accessible to the driver using both manual interactions and by voice. A reliable manual input mechanism is available using turn or push buttons in addition to voice recognition, which may not be accurate in all operating conditions. Voice recognition inputs can be limited to small numbers of words or phrases that can be more easily distinguished by a voice recognizer. Furthermore, voice outputs of the system are tailored to that they are readily recognizable to the driver. Manual input is optionally rejected in operating conditions in which such input is dangerous or prohibited.

Claims

1. A method for controlling a device in an environment using mixed manual and spoken input comprising:

prompting a user of the device using a combination of a visual prompt and an audible prompt, including

presenting a set of input choices,

accepting a command from the user to provide an audible prompt, and

in response to said command, playing an audible prompt that identifies one or more of the set of input choices;

monitoring an external condition in the environment of the device; and

accepting an input from the user in response to the visual and audible prompts, including limiting an input mode according to the external condition in the environment.

2. The method of claim 1 wherein presenting the set of input choices includes graphically presenting a list of the set of choices.

3. The method of claim 1 wherein presenting the set of input choices includes audibly presenting a list of the set of choices.

4. The method of claim 1 wherein accepting the command from the user to provide an audible prompt includes accepting a manual command.

5. The method of claim 1 wherein accepting the command from the user to provide an audible prompt includes accepting a spoken command.

6. The method of claim 1 wherein playing the audible prompt includes playing an audible representation of the one or more of the choices.

7. The method of claim 6 wherein playing the audible representation of the choices includes playing a spoken description of the choices.

8. The method of claim 7 wherein playing the audible representation of the choices further includes applying a speech synthesis algorithm to produce the spoken description.

9. The method of claim 7 wherein playing the audible representation of the choices further includes accessing a stored audio representation of the spoken description.

10. The method of claim 7 wherein playing the audible representation of the choices further includes receiving data characterizing the spoken description from a remote location.

11. The method of claim 1 wherein accepting the input in response to the visual and audible prompts includes accepting a manual input.

12. The method of claim 1 wherein accepting the input in response to the visual and audible prompts includes accepting a spoken input.

13. The method of claim 1 wherein limiting the input mode includes rejecting manual input.

14. The method of claim 13 wherein limiting the input made includes rejecting manual input when the speed of the vehicle exceeds a threshold speed.

15. The method of claim 1 wherein limiting the input mode includes rejecting spoken input.

16. The method of claim 1 wherein the environment of the device includes a motor vehicle and monitoring the condition of the environment includes monitoring the speed of the vehicle.

17. The method of claim 1 in which limiting the input mode includes rejecting a first category of manual inputs but allowing a second category of manual inputs.

18. The method of claim 17 in which the first category includes manual inputs that require the user to spend more time to complete than the manual inputs in the second category.

19. The method of claim 18 in which the first category includes a manual input that requires the user to select from a list of items.

20. A mobile device comprising:

a user interface including, a graphical display, a manual input device, an audio output device, and an audio input device;

a controller coupled to the user interface configured to

prompt a user of the device using the graphical display and the audio output device, including displaying a visual prompt that identifies a set of input choices on the graphical display, accepting a command from the user to provide an audible prompt, and in response to said command, playing an audible prompt using the audio output device that identifies one or more of the set of input choices,

monitor an external condition in an environment of the mobile device, and

accept an input from the user in response to the visual and audible prompts, including limiting an input mode according to the external condition in the environment.

21. The mobile device of claim 20 wherein limiting the input mode includes rejecting manual input.

22. The mobile device of claim 20 wherein limiting the input mode includes rejecting spoken input.

23. The mobile device of claim 20 wherein the environment of the device includes a motor vehicle and monitoring the condition of the environment includes monitoring the speed of the vehicle.

24. The mobile device of claim 20 wherein limiting the input mode includes rejecting manual input when the speed of the vehicle exceeds a threshold speed.

25. A method for controlling a device in a motor vehicle using mixed manual and spoken input comprising:

prompting a user of the device using a combination of a visual prompt and an audible prompt, including

presenting a set of input choices,

accepting a command from the user to provide an audible prompt, and

in response to said command, playing an audible prompt that identifies one or more of the set of input choices;

monitoring an external condition in the motor vehicle; and

accepting an input from the user in response to the visual and audible prompts, including limiting an input mode according to the external condition.