User device having sequential multimodal output user interface
First Claim
1. A method, comprising:
- operating at least one data processor of a handheld mobile device to present a user of the handheld mobile device with a notification of an event on a display screen, wherein the event comprises a plurality of attributes;
using an input modality of one of a plurality of input modalities of the mobile device and the at least one data processor to partition at least some of the attributes into a plurality of presentation tokens, where an individual presentation token comprises at least one attribute of the event;
defining one of the plurality of input modalities to generate a trigger condition for at least some individual ones of the presentation tokens, where generation of a trigger condition results in an associated presentation token being made manifest to the user via one of a plurality of output modalities of the handheld mobile device that is selectable by the user;
detecting user interaction in response to presenting the user with the notification of the event; and
generating one or more trigger conditions based on the user interaction.
3 Assignments
0 Petitions
Accused Products
Abstract
In one aspect of the exemplary embodiments of this invention an apparatus includes a user interface that contains a plurality of input modalities and a plurality of output modalities, and a data processor coupled with the user interface and configurable to present a user with a content item that includes a plurality of attributes. In response to user input that data processor is operable to partition at least some of the attributes into a plurality of presentation tokens, where an individual presentation token comprises at least one attribute. The data processor is further configurable to respond to further user input to define one of the plurality of input modalities to generate a trigger condition for individual ones of the presentation tokens, where generation of a trigger condition results in an associated presentation token being made manifest to the user. The plurality of input modalities may include two or more of physical or virtual keys, an input acoustic transducer, a speech recognition unit, and a gesture detection unit, and where the plurality of output modalities may include two or more of an output acoustic transducer, a speech synthesis unit, a vibro-tactile transducer, and a display screen.
-
Citations
31 Claims
-
1. A method, comprising:
-
operating at least one data processor of a handheld mobile device to present a user of the handheld mobile device with a notification of an event on a display screen, wherein the event comprises a plurality of attributes; using an input modality of one of a plurality of input modalities of the mobile device and the at least one data processor to partition at least some of the attributes into a plurality of presentation tokens, where an individual presentation token comprises at least one attribute of the event; defining one of the plurality of input modalities to generate a trigger condition for at least some individual ones of the presentation tokens, where generation of a trigger condition results in an associated presentation token being made manifest to the user via one of a plurality of output modalities of the handheld mobile device that is selectable by the user; detecting user interaction in response to presenting the user with the notification of the event; and generating one or more trigger conditions based on the user interaction. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 15, 16, 17)
-
-
13. A method, comprising:
-
operating at least one data processor of a mobile device to present a user of the mobile device with a notification on a display screen that comprises a plurality of attributes corresponding to the notification; in response to user input from an input modality of one of a plurality of input modalities of the mobile device, generating, using the at least one data processor, a sequence of presentation tokens by partitioning at least some of the attributes, where an individual presentation token comprises at least one attribute; receiving a first predefined user input from an input modality of one of the plurality of input modalities in response to presenting the user with the notification; in response to receiving the first predefined user input, providing a first presentation token of the sequence of presentation tokens to the user via one of a plurality of output modalities of the mobile device that is selectable by the user; receiving a second predefined user input from an input modality of one of the plurality of input modalities; and in response to the second predefined user input, providing a second presentation token of the sequence of presentation tokens to the user via one of the plurality of output modalities of the mobile device that is selectable by the user, wherein the second presentation token refines the level of detail or expands the amount of information as compared to the first presentation token. - View Dependent Claims (30, 31)
-
-
18. A non-transitory computer-readable medium that stores program instructions, the execution of the program instructions by at least one data processor of a handheld mobile device results in operations that comprise:
-
presenting a user with a notification of an event on a display screen, wherein the event comprises a plurality of attributes; in response to user input from an input modality of one of a plurality of input modalities of the mobile device, partitioning at least some of the attributes into a plurality of presentation tokens, where an individual presentation token comprises at least one attribute of the event; in response to further user input, defining one of the plurality of input modalities to generate a trigger condition for at least some individual ones of the presentation tokens, where generation of a trigger condition results in an associated presentation token being made manifest to the user via one of a plurality of output modalities of the handheld mobile device that is selectable by the user; and detecting user interaction in response to presenting the user with the notification of the event; generating one or more trigger conditions based on the user interaction. - View Dependent Claims (19, 20, 21, 22, 23, 24)
-
-
25. An apparatus, comprising:
-
a user interface comprised of a plurality of input modalities and a plurality of output modalities; a data processor; and a non-transitory memory including computer program code, the memory and the computer program code configured to, with the data processor, cause the apparatus at least to; present a user with a notification of an event on a touch-sensitive display screen, wherein the event comprises a plurality of attributes and, in response to user input, to partition at least some of the attributes into a plurality of presentation tokens, where an individual presentation token comprises at least one attribute of the event; respond to further user input to define one of said plurality of input modalities to generate a trigger condition for at least some individual ones of the presentation tokens, where generation of a trigger condition results in an associated presentation token being made manifest to the user via one of the plurality of output modalities that is selectable by the user; detecting user interaction in response to presenting the user with the notification of the event; and generate one or more trigger conditions based on the user interaction, wherein the apparatus is a handheld mobile device. - View Dependent Claims (26, 27, 28, 29)
-
Specification