Method and apparatus for using earcons in mobile communication devices

• US 20050125235A1
• Filed: 09/01/2004
• Published: 06/09/2005
• Est. Priority Date: 09/11/2003
• Status: Abandoned Application

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Voice Signal Technologies Incorporated (Microsoft Corporation)
• Inventors: Zlatkova, Tracy Mather, Lazay, Thomas, Cohen, Jordan, Barton, William
• Application Number:
  US10/932,341
• Publication Number:
  US 20050125235A1
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72448 with means for adapting the functionality of the device according to specific conditions
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons

Abstract

The apparatus and methods for using earcons as user prompts in mobile communication devices described herein are directed to implementing a mode of communication in these communication devices having speech recognition capabilities wherein spoken prompts are disabled and replaced with short identifiable sound prompts such as the earcons. In general, according to one aspect of the invention, a method for operating a communication device that includes speech recognition capabilities, comprises implementing on the device a user interface that employs a plurality of different user prompts, wherein each user prompt is for soliciting a corresponding spoken input from the user or informing the user about an action or state of the device; implementing on the device a plurality of different earcons, each earcon being mapped to a corresponding different one of the plurality of user prompts; and when any selected one of said plurality of user prompts is issued by the user interface on the device, generating the earcon that is mapped to the selected user prompt. Each prompt of the plurality of user prompts has a corresponding language representation and wherein generating the earcon for the selected user prompts includes generating the corresponding language representation through the user interface.

Claims

1. A method for operating a communication device that includes speech recognition capabilities, the method comprising:

implementing on the device a user interface that employs a plurality of different user prompts, wherein each user prompt of said plurality of different user prompts is for either soliciting a corresponding spoken input from the user or informing the user about an action or state of the device;

implementing on the device a plurality of different earcons, each earcon of said plurality of different earcons being mapped to a corresponding different one of said plurality of user prompts; and

when any selected one of said plurality of user prompts is issued by the user interface on the device, generating the earcon that is mapped to the selected user prompt.

2. The method of claim 1, wherein each prompt of the plurality of user prompts has a corresponding language representation and wherein generating the earcon for the selected user prompts comprises generating the corresponding language representation through the user interface.

3. The method of claim 2, wherein generating the corresponding language representation through the user interface further comprises visually displaying said language representation to the user.

4. The method of claim 2, wherein generating the corresponding language representation through the user interface further comprises audibly presenting said language representation to the user.

5. The method of claim 1, wherein each of the plurality of different earcons comprise a distinctive sound.

6. The method of claim 1, wherein the plurality of different earcons include at least one of compressed speech, a plurality of abstract sounds, and a plurality of sounds having different attributes such as varying pitch, tone and frequency.

7. The method of claim 2, further comprising:

implementing a plurality of user selectable modes having different user prompts.

8. The method of claim 7, further comprising a first mode in which whenever any of the plurality of different earcons is generated the corresponding language representation is also presented to the user.

9. The method of claim 8, further comprising a second mode in which the plurality of different earcons are generated without presenting the corresponding language representation.

10. The method of claim 9, further comprising selecting the second mode after operating the device in the first mode wherein the presentation of language representation is disabled.

11. The method of claim 1, wherein the device includes speech recognition capabilities to process an input from the user in response to the plurality of different earcons.

12. A mobile voice communication device comprising:

a wireless transceiver circuit for transmitting and receiving auditory information and for receiving data;

a processor; and

a memory storing executable instructions which when executed on the processor causes the mobile voice communication device to provide functionality to a user of the mobile voice communication device, said executable instructions including implementing on the device a user interface that employs a plurality of different user prompts, wherein each user prompt of said plurality of different user prompts is for either soliciting a corresponding spoken input from the user or informing the user about an action or state of the device;

implementing on the device a plurality of different earcons, each earcon of said plurality of different earcons being mapped to a corresponding different one of said plurality of user prompts; and

when any selected one of said plurality of user prompts is issued by the user interface on the device, generating the earcon that is mapped to the selected user prompt.

13. The mobile voice communication device of claim 12, wherein the mobile voice communication device is a mobile telephone device.

14. The mobile voice communication device of claim 12, wherein the functionality that is provided by the executable instructions comprises speech recognition.

15. The mobile voice communication device of claim 12, wherein the executable instructions further comprises:

implementing a plurality of user selectable modes including a first mode in which whenever any of the plurality of different earcons is generated the corresponding language representation is also presented to the user and a second mode in which the plurality of different earcons are generated without presenting the corresponding language representation.

16. The mobile voice communication device of claim 12, wherein each of the plurality of different earcons comprise any distinctive sound.

17. The mobile voice communication device of claim 12, wherein the plurality of different earcons include at least one of compressed speech, a plurality of abstract sounds, and a plurality of sounds having different pitch, tone and frequency attributes.

18. A computer readable medium including stored instructions adapted for execution on a process, comprising:

instructions for implementing on the device a user interface that employs a plurality of different user prompts, wherein each user prompt of said plurality of different user prompts is for either soliciting a corresponding spoken input from the user or informing the user about an action or state of the device;

instructions for implementing on the device a plurality of different earcons, each earcon of said plurality of different earcons being mapped to a corresponding different one of said plurality of user prompts; and

instructions for when any selected one of said plurality of user prompts is issued by the user interface on the device, generating the earcon that is mapped to the selected user prompt.

19. The computer readable medium of claim 18, wherein the medium is disposed within a mobile telephone apparatus and operates in conjunction with a user interface.

20. The computer readable medium of claim 18, wherein each of the plurality of different earcons comprise a distinctive sound.

21. The computer readable medium of claim 18, wherein the plurality of different earcons include at least one of compressed speech, a plurality of abstract sounds, and a plurality of sounds having different attributes such as varying pitch, tone and frequency.

22. A mobile voice communication device, comprising:

a first communication mode selectable by a user, wherein the user interface of the device generates at least two different types of user prompts for either soliciting a corresponding spoken input from the user or informing the user about an action or state of the device, wherein one of the at least two prompts is a plurality of language prompts and one is a plurality of earcon prompts; and

a second communication mode selectable by the user, wherein the user interface of the device generates the plurality of earcon prompts without generating the associated plurality of language prompts.

23. The mobile communication device of claim 22, wherein once the user has learned the association between each of the plurality of language prompts and each of the plurality of earcon prompts, the user selects the second mode by disabling the plurality of language prompts.

24. The mobile communication device of claim 22, wherein each of the plurality of earcon prompts comprise a distinctive sound.

25. The mobile communication device of claim 22, wherein the plurality of earcon prompts comprise at least one of compressed speech, a plurality of abstract sounds, and a plurality of sounds having varying pitch, tone and frequency attributes.

26. The mobile communication device of claim 22, wherein the first communication mode further comprises audibly presenting said plurality of language prompts to the user.

27. The mobile communication device of claim 22, wherein the first communication mode further comprising visually presenting said plurality of language prompts.