×

Method and apparatus for providing a multimodal user interface track

  • US 9,436,300 B2
  • Filed: 07/10/2012
  • Issued: 09/06/2016
  • Est. Priority Date: 07/10/2012
  • Status: Active Grant
First Claim
Patent Images

1. A method comprising:

  • on a device, presenting a user interface including a user interface element of a first track associated with a first user interface modality type of a media segment;

    including one or more scripts for initiating one or more actions associated with the media segment in at least one track of the media segment;

    determining, with a processor, one or more detected changes in contextual information associated with at least one of the user of the device or the device, wherein the one or more changes are detected during the presentation of the media segment;

    identifying an additional user interface modality type associated with the one or more detected changes in the contextual information;

    identifying a template associated with the additional user interface modality type;

    processing the media segment with respect to the template to modify the user interface element during the presentation based on the template and the identified additional user interface modality type associated with the one or more changes, wherein the user interface modality type comprises at least one of a visual modality, an audio modality, a tactile modality, an olfactory modality or a combination thereof;

    identifying one or more semantic elements based on the user interface modality type, wherein the one or more semantic elements describe characteristics or features of the media segment; and

    including the one or more semantic elements as at least one other track of the media segment.

View all claims
  • 4 Assignments
Timeline View
Assignment View
    ×
    ×