Document session replay for multimodal applications
First Claim
1. A method for document session replay for multimodal applications, the method implemented with a multimodal browser and a multimodal application operating on a multimodal device supporting multiple modes of user interaction with the multimodal application, the modes of user interaction including a voice mode and one or more non-voice modes, the method comprising:
- identifying, by a multimodal browser in dependence upon a log produced by a Form Interpretation Algorithm (‘
FIA’
) during a previous document session with a user, a speech prompt provided by a multimodal application in the previous document session;
identifying, by a multimodal browser in dependence upon the log, a response to the prompt provided by a user of the multimodal application in the previous document session;
retrieving, by the multimodal browser in dependence upon the log, an X+V page of the multimodal application associated with the speech prompt and the response;
rendering, by the multimodal browser, the visual elements of the retrieved X+V page on a display;
replaying, by the multimodal browser, the speech prompt via at least one speaker; and
replaying, by a multimodal browser, the response via at least one speaker.
3 Assignments
0 Petitions
Accused Products
Abstract
Methods, apparatus, and computer program products are described for document session replay for multimodal applications. including identifying, by a multimodal browser in dependence upon a log produced by a Form Interpretation Algorithm (‘FIA’) during a previous document session with a user, a speech prompt provided by a multimodal application in the previous document session; identifying, by a multimodal browser in replay mode in dependence upon the log, a response to the prompt provided by a user of the multimodal application in the previous document session; retrieving, by the multimodal browser in dependence upon the log, an X+V page of the multimodal application associated with the speech prompt and the response; rendering, by the multimodal browser, the visual elements of the retrieved X+V page; replaying, by the multimodal browser, the speech prompt; and replaying, by a multimodal browser, the response.
401 Citations
18 Claims
-
1. A method for document session replay for multimodal applications, the method implemented with a multimodal browser and a multimodal application operating on a multimodal device supporting multiple modes of user interaction with the multimodal application, the modes of user interaction including a voice mode and one or more non-voice modes, the method comprising:
-
identifying, by a multimodal browser in dependence upon a log produced by a Form Interpretation Algorithm (‘
FIA’
) during a previous document session with a user, a speech prompt provided by a multimodal application in the previous document session;identifying, by a multimodal browser in dependence upon the log, a response to the prompt provided by a user of the multimodal application in the previous document session; retrieving, by the multimodal browser in dependence upon the log, an X+V page of the multimodal application associated with the speech prompt and the response; rendering, by the multimodal browser, the visual elements of the retrieved X+V page on a display; replaying, by the multimodal browser, the speech prompt via at least one speaker; and replaying, by a multimodal browser, the response via at least one speaker. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. An apparatus for document session replay for multimodal applications, the apparatus including a multimodal browser and a multimodal application operating on a multimodal device supporting multiple modes of user interaction with the multimodal application, the modes of user interaction including a voice mode and one or more non-voice modes, the apparatus comprising a computer processor and a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions capable of:
-
identifying, in dependence upon a log produced by a Form Interpretation Algorithm (‘
FIA’
) during a previous document session with a user, a speech prompt provided by a multimodal application in the previous document session;identifying, in dependence upon the log, a response to the prompt provided by a user of the multimodal application in the previous document session; retrieving, in dependence upon the log, an X+V page of the multimodal application associated with the speech prompt and the response; rendering, the visual elements of the retrieved X+V page on a display; replaying the speech prompt via at least one speaker; and replaying the response via at least one speaker. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A computer program product for document session replay for multimodal applications, the computer program product including a multimodal application operating on a multimodal device supporting multiple modes of user interaction with the multimodal application, the modes of user interaction including a voice mode and one or more non-voice modes, the computer program product disposed upon a computer-readable recording medium, the computer program product comprising computer program instructions capable of:
-
identifying, in dependence upon a log produced by a Form Interpretation Algorithm (‘
FIA’
) during a previous document session with a user, a speech prompt provided by a multimodal application in the previous document session;identifying, in dependence upon the log, a response to the prompt provided by a user of the multimodal application in the previous document session; retrieving, in dependence upon the log, an X+V page of the multimodal application associated with the speech prompt and the response; rendering, the visual elements of the retrieved X+V page on a display; replaying the speech prompt via at least one speaker; and replaying the response via at least one speaker. - View Dependent Claims (16, 17, 18)
-
Specification