Systems, methods, means, and media for recording, searching, and outputting display information
First Claim
1. A system for recording display information, comprising:
- a virtual display that;
intercepts display-changes describing changes to be made to a state of a display;
sends the display-changes to a client for display; and
records the display-changes;
a context recorder that uses accessibility mechanisms to record context information derived independently of screen-images,wherein the accessibility mechanisms include mechanisms utilized by a screen reader for providing desktop access for visually impaired individuals; and
wherein the context information includes (1) text that is displayed in at least one application window, (2) a duration in which the text is displayed on the at least one application window and (3) at least one of a font type of the text, a font size of the text, and an identifier of the at least one application window, that are extracted through the accessibility mechanisms;
a search tool that;
receives a user query from a user;
determines whether the user query matches any of the context information; and
based on the whether the user query matches any of the context information, determines a correspondence between context information that matched the query and at least one of the display changes; and
a display system that;
generates an output screen-image based at least in part on the at least one of the display-changes determined to have a correspondence with the context information that matched the query.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems for recording, searching, and outputting display information are provided. In some embodiments, systems for recording display information are provided. The systems include a virtual display that: intercepts display-changes describing changes to be made to a state of a display; sends the display-changes to a client for display; records the display-changes; and a context recorder that records context information describing a state of the display derived from a source independently of the display changes and independently of screen-images. In some embodiments, the systems further include a display system that generates an output screen-image based at least in part on at least one of the display-changes and in response to a search of the context information. In some embodiments, the virtual display further records screen-images; and the display system further generates the output screen-image based at least in part on a recorded-screen-image of the recorded screen-images.
-
Citations
11 Claims
-
1. A system for recording display information, comprising:
-
a virtual display that; intercepts display-changes describing changes to be made to a state of a display; sends the display-changes to a client for display; and records the display-changes; a context recorder that uses accessibility mechanisms to record context information derived independently of screen-images, wherein the accessibility mechanisms include mechanisms utilized by a screen reader for providing desktop access for visually impaired individuals; and wherein the context information includes (1) text that is displayed in at least one application window, (2) a duration in which the text is displayed on the at least one application window and (3) at least one of a font type of the text, a font size of the text, and an identifier of the at least one application window, that are extracted through the accessibility mechanisms; a search tool that; receives a user query from a user; determines whether the user query matches any of the context information; and based on the whether the user query matches any of the context information, determines a correspondence between context information that matched the query and at least one of the display changes; and a display system that; generates an output screen-image based at least in part on the at least one of the display-changes determined to have a correspondence with the context information that matched the query. - View Dependent Claims (2, 3)
-
-
4. A method for recording display information, comprising:
-
intercepting display-changes describing changes to be made to a state of a display; sending the display-changes to a client for display; recording the display-changes; recording context information using accessibility mechanisms, wherein the context information is derived independently of screen-images; wherein the accessibility mechanisms include mechanisms utilized by a screen reader for providing desktop access for visually impaired individuals; and wherein the context information includes (1) text that is displayed in at least one application window, (2) a duration in which the text is displayed on the at least one application window and (3) at least one of a font type of the text, a font size of the text, and an identifier of the at least one application window, that are extracted through the accessibility mechanisms; receiving a user query from a user; determining whether the user query matches any of the context information; and based on the whether the user query matches any of the context information, outputting at least one result describing a state of the display generated based at least in part on at least one of the display-changes. - View Dependent Claims (5, 10)
-
-
6. A non-transitory computer-readable medium containing computer-executable instructions that, when executed by a processor, cause the processor to perform a method for recording display information, the method comprising:
-
intercepting display-changes describing changes to be made to a state of a display; sending the display-changes to a client for display; recording the display-changes; recording context information using accessibility mechanisms, wherein the context information is derived independently of screen-images; wherein the accessibility mechanisms include mechanisms utilized by a screen reader for providing desktop access for visually impaired individuals; and wherein the context information includes (1) text that is displayed in at least one application window, (2) a duration in which the text is displayed on the at least one application window and (3) at least one of a font type of the text, a font size of the text, and an identifier of the at least one application window, that are extracted through the accessibility mechanisms; receiving a user query from a user; determining whether the user query matches any of the context information; and based on the whether the user query matches any of the context information, outputting at least one result describing a state of the display generated based at least in part on at least one of the display-changes. - View Dependent Claims (7, 11)
-
-
8. A system for recording, searching, and outputting display information, comprising:
-
a display recorder that receives and stores; display-image-state information including a first screen-image of a display at a first time and a second screen-image of the display at a second time that is after the first time; display-command information including; at least one first command that describes advancing the first screen-image to a third screen-image of the display at a third time that is between the first time and the second time; and at least one second command that describes advancing the second screen-image to a fourth screen-image of the display at a fourth time that is after the third time; a text recorder that receives; text displayed in at least one application window at the third time, wherein the text displayed at the third time is extracted independently of screen-images through accessibility mechanisms and wherein the accessibility mechanisms include mechanisms utilized by a screen reader for providing desktop access for visually impaired individuals; and text displayed in at least one application window at the fourth time, wherein the text displayed at the fourth time is extracted independently of screen-images through the accessibility mechanisms; a search tool that; receives a user query; and determines whether the user query matches the text displayed at the third time or matches the text displayed at the fourth time; and a display system that, based on whether the user query matches the text displayed at the third time or matches the text displayed at the fourth time; alters either the first screen-image by applying the at least one first command to generate a third screen-image or alters the second screen-image by applying the at least one second command to generate a fourth screen-image; and outputs either the third screen-image or the fourth screen-image. - View Dependent Claims (9)
-
Specification