METHOD AND APPARATUS FOR PROVIDING A MULTIMODAL USER INTERFACE TRACK

• US 20140019860A1
• Filed: 07/10/2012
• Published: 01/16/2014
• Est. Priority Date: 07/10/2012
• Status: Active Grant

• Current Assignee: Fixapa Sendirian Berhad
• Original Assignee: Nokia Corporation
• Inventors: Sathish, Sailesh Kumar, Curcio, Igor Danilo Diego
• Granted Patent: US 9,436,300 B2
• Time in Patent Office: Days
• US Class Current: 715/716
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: H04N 21/4621 Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10

Abstract

An approach is provided for providing a multimodal user interface track. A multimodal generation platform determining one or more user interface elements for interacting with at least one media segment. The multimodal generation platform further causes, at least in part, an inclusion of the one or more user interface elements as at least one track of the at least one media segment. Accordingly, when the at least one track is processed during a presentation of the at least one media segment by at least one device, the at least one track causes, at least in part, an enablement of the one or more user interface elements.

Claims

1. A method comprising facilitating a processing of and/or processing (1) data and/or (2) information and/or (3) at least one signal, the (1) data and/or (2) information and/or (3) at least one signal based, at least in part, on the following:

one or more user interface elements for interacting with at least one media segment; and

an inclusion of the one or more user interface elements as at least one track of the at least one media segment,

wherein the at least one track is processed during a presentation of the at least one media segment by at least one device to cause, at least in part, an enablement of the one or more user interface elements.

2. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing of capability information, preference information, contextual information, or a combination thereof associated with the at least one device to determine the one or more user interface elements.

3. A method of claim 2, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination that the capability information, preference information, the contextual information, or a combination thereof is at least partially incomplete; and

at least one determination the one or more user interface elements based, at least in part, on one or more default criteria.

4. A method of claim 1, wherein the one or more user interface elements are based, at least in part, on one or more modality types including, at least in part, a visual modality, an audio modality, a tactile modality, an olfactory modality, or a combination thereof.

5. A method of claim 4, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

one or more templates associated with the one or more modality types; and

a processing of the at least one media segment with respect to the one or more templates to determine the one or more user interface elements, the at least one track, or a combination thereof.

6. A method of claim 5, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

one or more words, one or more tokens, or a combination thereof with respect to an audio modality template; and

a processing of the at least one media segment with respect to the one or more words, the one or more tokens, or a combination thereof to determine the one or more user interface elements.

7. A method of claim 6, wherein the one or more words, the one or more tokens, or a combination thereof are based, at least in part, on one or more datasets located at the at least one device.

8. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

one or more scripts for initiating one or more actions associated with the at least one media segment; and

an inclusion of the one or more scripts in the at least one track,

wherein the one or more scripts are processed during the presentation.

9. A method of claim 8, wherein the one or more scripts are for user feedback information regarding the at least one media segment, one or more contextual event handlers, or a combination thereof.

10. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

one or more semantic elements for describing the at least one media segment; and

an inclusion of the one or more semantic elements as at least one other track of the at least one media segment.

11. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

determine one or more user interface elements for interacting with at least one media segment; and

cause, at least in part, an inclusion of the one or more user interface elements as at least one track of the at least one media segment,

wherein the at least one track is processed during a presentation of the at least one media segment by at least one device to cause, at least in part, an enablement of the one or more user interface elements.

12. An apparatus of claim 11, wherein the apparatus is further caused to:

process and/or facilitate a processing of capability information, preference information, contextual information, or a combination thereof associated with the at least one device to determine the one or more user interface elements.

13. An apparatus of claim 12, wherein the apparatus is further caused to:

determine that the capability information, preference information, the contextual information, or a combination thereof is at least partially incomplete; and

determine the one or more user interface elements based, at least in part, on one or more default criteria.

14. An apparatus of claim 11, wherein the one or more user interface elements are based, at least in part, on one or more modality types including, at least in part, a visual modality, an audio modality, a tactile modality, an olfactory modality, or a combination thereof.

15. An apparatus of claim 14, wherein the apparatus is further caused to:

determine one or more templates associated with the one or more modality types; and

process and/or facilitate a processing of the at least one media segment with respect to the one or more templates to determine the one or more user interface elements, the at least one track, or a combination thereof.

16. An apparatus of claim 15, wherein the apparatus is further caused to:

determine one or more words, one or more tokens, or a combination thereof with respect to an audio modality template; and

process and/or facilitate a processing of the at least one media segment with respect to the one or more words, the one or more tokens, or a combination thereof to determine the one or more user interface elements.

17. An apparatus of claim 16, wherein the one or more words, the one or more tokens, or a combination thereof are based, at least in part, on one or more datasets located at the at least one device.

18. An apparatus of claim 11, wherein the apparatus is further caused to:

determine one or more scripts for initiating one or more actions associated with the at least one media segment; and

cause, at least in part, an inclusion of the one or more scripts in the at least one track,

wherein the one or more scripts are processed during the presentation.

19. An apparatus of claim 18, wherein the one or more scripts are for user feedback information regarding the at least one media segment, one or more contextual event handlers, or a combination thereof.

20. An apparatus of claim 11, wherein the apparatus is further caused to:

determine one or more semantic elements for describing the at least one media segment; and

cause, at least in part, an inclusion of the one or more semantic elements as at least one other track of the at least one media segment.

21-48. -48. (canceled)