METHOD AND APPARATUS FOR FACILITATING INTERACTING WITH A MULTIMODAL USER INTERFACE

• US 20120280915A1
• Filed: 05/02/2011
• Published: 11/08/2012
• Est. Priority Date: 05/02/2011
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Kinnunen, Timo, Kyllönen, Janne Vihtori, Arnowitz, Jonathon
• Application Number:
  US13/098,664
• Publication Number:
  US 20120280915A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Methods and apparatuses are provided for facilitating interaction with a multimodal user interface. A method may include displaying at least one display element on a touch display, the display element comprising a voice input capable indicator and being configured to perform an operation. The method may further include receiving a voice input. The method may additionally include causing, based at least in part on the voice input, the performance of the operation associated with the display element of the touch display user-interface.

Claims

1. A method comprising:

causing display of at least one display element on a display, the display element being configured to perform an operation when touched;

receiving a voice input; and

causing the performance of the operation associated with the display element of the display when the voice input corresponds to the at least one display element.

2. A method of claim 1, wherein the display element further comprises a readable command, the readable command being configured to cause the performance of the operation associated with the display element of a touch display user-interface.

3. A method of claim 1, wherein the display element further comprises a voice command indicator, the voice command indicator being configured to indicate the display element is configured to cause the performance of the operation associated with the display element of a touch display user-interface based at least in part upon a voice input associated with the display element.

4. A method of claim 1, wherein causing the performance of the operation associated with the display element further comprises causing, based at least in part on a user engaging the at least one display element by contacting the element, the performance of the operation associated with the display element of a touch display user-interface.

5. A method of claim 1, wherein the display further comprises a touch display, the touch display configured to display a touch display element.

6. A method of claim 1, further comprising causing the performance of an operation associated with the display element by simultaneously engaging the touch display and providing a user interface control circuitry with a voice input.

7. An apparatus comprising at least one processor and at least one memory storing computer program code, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to at least:

cause the display at least one display element on a display, the display element being configured to perform an operation when touched;

receive a voice input; and

cause the performance of the operation associated with the display element of the display when the voice input corresponds to the at least one display element.

8. The apparatus of claim 7 further comprising a mobile phone, the phone comprising a touch display user-interface.

9. The apparatus of claim 7 further comprising a touch display, the touch display, configured to display a touch display element.

10. The apparatus of claim 7, wherein the display element further comprises a readable command, the readable command being substantially the same as the voice input configured to cause the performance of the operation associated with the display element of the touch display user-interface.

11. The apparatus of claim 7, wherein the display element further comprises a voice command indicator, the voice command indicator being configured to indicate the display element is configured to cause the performance of the operation associated with the display element of a touch display user-interface based at least in part upon a voice input associated with the display element.

12. The apparatus of claim 7, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to cause, based at least in part on a user engaging the at least one display element by contacting the element, the performance of the operation associated with the display element of the touch display user-interface.

13. The apparatus of claim 7, wherein the at least one memory and stored computer program code are configured, with the at least one processor, to cause the apparatus to cause the performance of an operation associated with the display element of the touch display user-interface by engaging a touch display element simultaneously with providing a user interface control circuitry with a voice input.

14. A computer program product comprising at least one non-transitory computer-readable storage medium having computer-readable program instructions stored therein, the computer-readable program instructions comprising program instructions configured to cause an apparatus to perform a method comprising:

causing display of at least one display element on a display, the display element being configured to perform an operation when touched;

receiving a voice input; and

causing the performance of the operation associated with the display element of the display when the voice input corresponds to the at least one display element.

15. The computer program product of claim 14, wherein the display element further comprises a readable command, the readable command being substantially the same as the voice input configured to cause the performance of the operation associated with the display element of the touch display user-interface.

16. The computer program product of claim 14, wherein the display element further comprises a voice command indicator, the voice command indicator being configured to indicate the display element is configured to cause the performance of the operation associated with the display element of a touch display user-interface based at least in part with a voice input associated with the display element.

17. The computer program product of claim 14, wherein causing the performance of the operation associated with the display element further comprises causing, based at least in part on a user engaging the at least one display element by contacting the element, the performance of the operation associated with the display element of the touch display user-interface.

18. The computer program product of claim 14 further comprising a touch display, the touch display configured to display a touch display element.

19. The computer program product of claim 14 further causing the performance of an operation associated with the display element by simultaneously engaging the touch display and providing a user interface control circuitry with a voice input.