User interface for multimodal information system
First Claim
Patent Images
1. A graphical user interface displayed on a portable wireless electronic device for providing context-based information services by interpreting visual imagery on the portable wireless electronic device comprising:
- a display displaying a first tab comprising a first tab pane comprising a video display region, a first plurality of video controls below the video display region, and a first text box having a first area size, wherein the first text box overlays the video display region, the video display region comprises a video, and the first text box comprises at least a portion of an augmentation information associated with the video, wherein the augmentation information is generated by;
a user selecting text displayed in the video,recognizing the selected text in the video,generating a context based on the selected text, andusing the generated context in a search for relevant augmentation information to present in the first text box; and
a second tab comprising a second tab pane comprising a second text box having a second area size, greater than the first area size, wherein the second text box comprises the augmentation information displayed in the first text box, and when the second tab is selected, the second tab pane overlays the first tab pane, wherein the augmentation displayed in the first text box is read-only and the augmentation displayed in the second text box can be edited by the user.
2 Assignments
0 Petitions
Accused Products
Abstract
A method and system for providing a user interface for information services related to multimodal information on a computer system is presented. A system for providing a user interface for augmenting multimodal information with information services and interacting with the information services is described.
21 Citations
16 Claims
-
1. A graphical user interface displayed on a portable wireless electronic device for providing context-based information services by interpreting visual imagery on the portable wireless electronic device comprising:
-
a display displaying a first tab comprising a first tab pane comprising a video display region, a first plurality of video controls below the video display region, and a first text box having a first area size, wherein the first text box overlays the video display region, the video display region comprises a video, and the first text box comprises at least a portion of an augmentation information associated with the video, wherein the augmentation information is generated by; a user selecting text displayed in the video, recognizing the selected text in the video, generating a context based on the selected text, and using the generated context in a search for relevant augmentation information to present in the first text box; and a second tab comprising a second tab pane comprising a second text box having a second area size, greater than the first area size, wherein the second text box comprises the augmentation information displayed in the first text box, and when the second tab is selected, the second tab pane overlays the first tab pane, wherein the augmentation displayed in the first text box is read-only and the augmentation displayed in the second text box can be edited by the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
Specification