AUDIO RECOGNITION DURING VOICE SESSIONS TO PROVIDE ENHANCED USER INTERFACE FUNCTIONALITY

• US 20110014952A1
• Filed: 07/15/2009
• Published: 01/20/2011
• Est. Priority Date: 07/15/2009
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications USA Incorporated (Sony Group Corp.)
• Inventors: MINTON, Wayne Christopher
• Application Number:
  US12/503,410
• Publication Number:
  US 20110014952A1
• Time in Patent Office: Days
• US Class Current: 455/566
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/088 Word spotting
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: H04M 1/271 controlled by voice recognition

Abstract

The user interface for a mobile communication device may be provided based on the current context of a voice session, as recognized by an automated audio recognition engine. In one implementation, the mobile device may transcribe, by an audio recognition engine in the mobile device, audio from a voice session conducted through the mobile device; detect, by the mobile device and based at least on the transcribed audio, changes in context during the voice session that relate to a change in functionality of the user interface of the mobile device; and update, by the mobile device, the user interface in response to the detected change in context.

Claims

1. A method comprising:

presenting, by a mobile device, a user interface through which a user of the mobile device interacts with the mobile device;

transcribing, by an audio recognition engine in the mobile device, audio from a voice session conducted through the mobile device;

detecting, by the mobile device and based at least on the transcribed audio, changes in context during the voice session that relate to a change in functionality of the user interface of the mobile device; and

updating, by the mobile device, the user interface in response to the detected change in context.

2. The method of claim 1, where the user interface is presented through a touch screen display.

3. The method of claim 1, where detecting changes in the context includes:

matching the transcribed audio to one or more pre-stored phrases.

4. The method of claim 1, further comprising:

detecting the changes in context as a change corresponding to prompts from an interactive voice response (IVR) system.

5. The method of claim 4, further comprising:

updating the user interface to include a visual numeric key pad configured to accept numeric input from the user.

6. The method of claim 4, further comprising:

updating the user interface to include interactive elements generated dynamically based on the voice session.

7. The method of claim 1, where detecting the changes in the context further includes:

detecting changes in the context for select telephone numbers corresponding to the voice session.

8. The method of claim 6, where detecting the changes in the context further includes:

detecting changes in the context in response to an explicit indication from the user that the voice session is one for which context changes should be detected.

9. A mobile communication device comprising:

a touch screen display;

an audio recognition engine to receive audio from a called party during a voice session through the mobile communication device;

a context match component to;

receive an output of the audio recognition engine, and

based on the output, determine whether to update a user interface presented on the touch screen display; and

a user interface control component to control the touch screen display to present the updated user interface.

10. The mobile communication device of claim 9, where the context match component is further to update the user interface to include additional functionality relevant to a current context of the voice session.

11. The mobile communication device of claim 9, where the audio recognition engine is further to output a transcription of audio received from the called party.

12. The mobile communication device of claim 9, where the audio recognition engine is further to output an indication of commands recognized in audio corresponding to the called party.

13. The mobile communication device of claim 9, where the context match component is further to determine whether to update the user interface based on a matching of the output of the audio recognition engine to one or more pre-stored phrases.

14. The mobile communication device of claim 9, where the user interface control component is further to update the user interface to include a visual numeric key pad configured to accept numeric input from the user.

15. The mobile communication device of claim 9, where the user interface control component is further to update the user interface to include interactive elements generated dynamically based on the voice session.

16. The mobile communication device of claim 9, where the context match component is further to determine whether to update the user interface for select telephone numbers corresponding to the voice session.

17. The mobile communication device of claim 9, where the context match component is further to determine whether to update the user interface in response to an explicit indication from the user that the voice session is one that should be monitored by the context match component.

18. A mobile device comprising:

means for presenting a user interface through which a user of the mobile device interacts with the mobile device;

means for transcribing audio from a voice session conducted through the mobile device;

means for detecting, based at least on the transcribed audio, changes in context during the voice session that relate to a change in functionality of the user interface of the mobile device; and

means for updating the user interface in response to the detected change in context.

19. The device of claim 18, where the means for detecting detects the changes in context as a change corresponding to prompts from an interactive voice response (IVR) system.

20. The device of claim 18, further comprising:

means for detecting the changes in context as a change corresponding to prompts from an interactive voice response (IVR) system.