Dynamic zooming of content with overlays

• US 10,474,735 B2
• Filed: 03/14/2013
• Issued: 11/12/2019
• Est. Priority Date: 11/19/2012
• Status: Active Grant

• Current Assignee: Acoustic, L.P.
• Original Assignee: Acoustic, L.P.
• Inventors: DeLoach, Kevin, Simon, Shawn, Fraschetti, Christopher, Cordasco, Matthew
• Primary Examiner(s): Lee, Justin S
• Assistant Examiner(s): Norris, Benjamin J
• Application Number:
  US13/828,476
• Publication Number:
  US 20140143652A1
• Time in Patent Office: 2,434 Days
• Field of Search: 715760, 715234
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06F 9/545 where tasks reside in different layers, e.g. user- and kernel-space

Abstract

A dynamic zooming system may use overlays to display usage information over associated webpages. In one example, a replay manager may zoom-in on particular areas of the webpages to view more specific usage information. In another example, the replay manager may zoom-out the webpages to view more general usage information. The dynamic zooming system may use a first scaled overlay layer to dynamically vary a zoom level of the usage information to match a zoom level for the webpages. The dynamic zooming system also may use a second fixed overlay layer to display other usage information independently of the zoom-level for the webpages.

Claims

1. A computer program product for replaying an application session, the computer program product comprising a computer readable storage medium having program code embodied wherewith, wherein the computer readable storage medium is not a transitory medium, the program code readable/executable by a computer to perform a method comprising:

initiating, by the computer, a replay of one or more application sessions captured over one or more selected time periods, by;

displaying, by the computer, one or more webpage objects within a content layer of a webpage, and

displaying, by the computer, usage information captured during the one or more application sessions over the one or more selected time periods and associated with the one or more webpage objects within a scaled layer of the webpage, wherein the scaled layer operates above the content layer and the usage information is displayed in the scaled layer over the one or more webpage objects within the content layer and corresponds to one or more user events associated with the one or more webpage objects within the content layer, and wherein the usage information is placed within the scaled layer to prevent changes in a zoom level of the content layer from affecting the display of the usage information;

detecting, by the computer, a change in the zoom level of the content layer during the replay of the one or more application sessions;

changing, by the computer, during the replay of the one or more application sessions, the zoom level of the usage information displayed within the scaled layer based on the zoom level of the content layer and in response to detecting the change in the zoom level of the content layer;

identifying, by the computer, during the replay of the one or more application sessions, a portion of the usage information associated with a first object located within the scaled layer;

in response to identifying the portion of the usage information associated with the first object, communicating, by the computer, during the replay of the one or more application sessions, the portion of the usage information from the first object located within the scaled layer to a second object located within a fixed layer of the webpage and displaying the portion of the usage information associated with the second object within the fixed layer of the webpage, wherein the fixed layer is an HTML element that is separate from the content layer and the scaled layer such that the fixed layer is independent of the zoom level of the content layer and two-way communication between the scaled layer and the fixed layer is enabled by the scaled layer; and

displaying, by the computer, during the replay of the one or more application sessions, additional usage information associated with the one or more webpage objects within the fixed layer of the webpage, wherein a zoom level of the additional usage information within the fixed layer is unaffected by the detected change in the zoom level of the content layer and wherein the additional usage information is dynamically updated based on the detected change in the zoom level of the content layer and one or more user events associated with the one or more webpage objects.

2. The computer program product of claim 1, wherein the webpage objects comprise a first set of hypertext markup language (HTML) objects for a webpage within the content layer and the usage information is displayed by a second set of HTML objects within the scaled layer.

3. The computer program product of claim 1, wherein the method further comprises displaying, by the computer, the usage information within the scaled layer at a Z-index level above the content layer.

4. The computer program product of claim 1, wherein the method further comprises displaying, by the computer, a heatmap within the scaled layer over the content layer, wherein the usage information is displayed within the heatmap.

5. The computer program product of claim 1, wherein the method further comprises:

inserting, by the computer, an inline frame (IFRAME) within a webpage containing the webpage objects; and

displaying, by the computer, the usage information within the IFRAME.

6. The computer program product of claim 1, wherein the method further comprises:

generating, by the computer, usage clusters from the usage information;

identifying, by the computer, the webpage objects associated with the usage clusters; and

displaying, by the computer, the usage clusters within the scaled layer over the associated webpage objects.

7. The computer program product of claim 6, wherein changing the zoom level of the content layer changes a size and location of the webpage objects and changing the zoom level of the scaled layer changes a size and location of the usage clusters to maintain substantially a same relative position and coverage over the associated webpage objects.

8. The computer program product of claim 1, wherein the method further comprises:

displaying, by the computer, form fields over the webpage objects;

displaying, by the computer, the usage information within the form fields; and

varying, by the computer, sizes of the form fields and sizes of the usage information displayed within the form fields based on the zoom level of the content layer.

9. The computer program product of claim 1, wherein the method further comprises:

detecting, by the computer, selection of the usage information for an associated one of the webpage objects;

displaying, by the computer, a highlighted overlay within the scaled layer over the associated one of the webpage objects; and

varying, by the computer, a zoom level of the highlighted overlay based on the zoom level of the content layer.

10. The computer program product of claim 1, wherein the method further comprises:

displaying, by the computer, the usage information within the scaled layer at a Z-index level above the content layer; and

displaying, by the computer, the additional usage information within the fixed layer at a Z-index level above the scaled layer.

11. The computer program product of claim 1, wherein the method further comprises updating, by the computer, the additional usage information within the fixed layer based on the zoom level of the content layer.

12. The computer program product of claim 1, wherein the method further comprises:

inserting, by the computer, a Document Division Element (DIV) container into the content layer; and

displaying the fixed layer within the DIV container.

13. The computer program product of claim 1, wherein the method further comprises:

generating, by the computer, control icons configured to control the zoom level of the content layer; and

displaying, by the computer, the control icons within the fixed layer.

14. The computer program product of claim 1, wherein the method further comprises:

displaying, by the computer, an analysis box within the fixed layer, wherein the analysis box covers a portion of the usage information, and wherein a zoom level of the analysis box is unaffected by the detected change in the zoom level of the content layer;

counting, by the computer, a first number of events for the usage information covered by the analysis box prior to detecting the change in the zoom level of the content layer;

displaying, by the computer, the first number of events within a usage report in the fixed layer;

counting, by the computer, a second number of events for the usage information covered by the analysis box in response to detecting the change in the zoom level of the content layer, wherein the analysis box covers a different portion of the usage information due to the change in the zoom level of the content layer; and

updating, by the computer, the usage report to display the second number of events in response to counting the second number of events.

26. The computer program product of claim 1, wherein the method further comprises:

displaying, by the computer, an additional webpage object within the content layer in response to the change in the zoom level of the content layer; and

displaying, by the computer, usage information associated with the additional webpage object within the scaled layer in response to the additional webpage object being displayed within the content layer.

28. The computer program product of claim 1, wherein the method further comprises:

detecting an interaction with a zoom controller located within the fixed layer;

generating a request for the change in the zoom level of the content layer based on the interaction with the zoom controller; and

performing the change in the zoom level of the content layer based on the request.

15. An apparatus, comprising:

a memory configured to store objects and store usage information associated with one or more webpage objects; and

logic circuitry configured to;

initiate a replay of one or more application sessions captured over one or more selected time periods, by;

displaying a webpage comprising the one or more webpage objects within a computer screen, and

displaying the usage information captured during the one or more application sessions over the one or more selected time periods in a scaled overlay over the associated one or more webpage objects, wherein the usage information corresponds to one or more user events associated with the one or more webpage objects, and wherein the usage information is placed within the scaled layer to prevent changes in a zoom level of the content layer from affecting the display of the usage information;

detect an input changing a size of the webpage comprising the one or more webpage objects during the replay of the one or more application sessions;

vary, during the replay of the one or more application sessions, a size of the scaled overlay based on the size of the webpage comprising the one or more webpage objects;

identify, during the replay of the one or more application sessions, a portion of the webpage displayed within the computer screen after the change in the size of the webpage and usage information associated with a first object located within the scaled overlay, wherein the usage information associated with the first object corresponds to one or more user events associated with the one or more webpage objects within the portion of the webpage displayed within the computer screen after the change in the size of the webpage;

in response to identifying the portion of the webpage displayed within the computer screen after the change in the size of the webpage and usage information associated with the first object within the scaled overlay, communicate, during the replay of the one or more application sessions, from the first object to a second object located within a fixed overlay, the usage information associated with the first object and dynamically display the usage information associated with the first object by the second object within the fixed overlay of the computer screen, wherein the fixed overlay is an HTML element that is separate from the scaled overlay such that objects displayed in the fixed overlay and the scaled overlay do not alter the one or more webpage objects and two-way communication between the scaled overlay and the fixed overlay is enabled by the scaled overlay; and

display, during the replay of the one or more application sessions, additional usage information in the fixed overlay independently of changes to the size of the one or more objects, wherein the additional usage information is dynamically updated based on the detected change in the size of the webpage comprising the one or more webpage objects and the one or more user events associated with the one or more objects.

16. The apparatus of claim 15, wherein the objects comprise webpage objects within a hypertext markup language (HTML) webpage and the logic circuitry is further configured to insert HTML objects within the HTML webpage configured to display the usage information and vary a display size of the usage information based on the size of the HTML webpage.

17. The apparatus of claim 15, wherein the logic circuitry is further configured to:

detect a change in a zoom level of the objects; and

change a zoom level of the usage information in the scaled overlay to match the zoom level of the objects.

18. The apparatus of claim 15, wherein the logic circuitry is further configured to:

derive usage clusters from the usage information, wherein the usage clusters show selection locations for the objects;

vary a zoom level of the objects; and

vary a zoom level of the usage clusters based on the zoom level of the objects.

19. The apparatus of claim 15, wherein the objects comprise HTML webpage objects and the scaled overlay comprises HTML objects configured to display the usage information on a Z-index layer above the HTML webpage objects.

20. The apparatus of claim 15, wherein the logic circuitry is further configured to display control elements within the fixed overlay, wherein the control elements are displayed in the fixed overlay independently of changes to the size of the objects.

21. The apparatus of claim 20, wherein the logic circuitry is further configured to change the size of the objects in response to inputs generated by the control elements.

27. The apparatus of claim 15, wherein the logic circuitry is further configured to:

display a usage report including the usage information associated with the objects displayed within the computer screen prior to changing the size of the objects;

remove a portion of the objects from display within the computer screen in response to changing the size of the objects; and

update the usage report to include usage information associated with the objects displayed within the computer screen after removing the portion of the objects.

22. A system, comprising:

a database configured to store one or more webpages displayed during one or more web sessions and store one or more user inputs entered during the one or more web sessions;

a content server configured to generate analytics associated with the one or more webpages based on the user inputs; and

a computing device configured to;

initiate a replay of one or more application sessions captured over one or more selected time periods, by;

displaying the one or more webpages during an analysis session, and

displaying the analytics in scaled overlays over the one or more webpages, wherein the analytics are placed within the scaled overlays to prevent changes in a zoom level of the one or more webpages from affecting the display of the analytics;

receive, during the replay of the one or more application sessions, an input changing the zoom level of the one or more webpages;

vary, during the replay of the one or more application sessions, the zoom level of the scaled overlays based on the zoom level of the one or more webpages and in response to changing the zoom level of the one or more webpages;

identify, during the replay of the one or more application sessions, a portion of the one or more webpages displayed after the change in the zoom level of the one or more webpages and analytics associated with a first object located within the scaled overlays, wherein the analytics associated with the first object corresponds to one or more user events associated with the portion of the one or more webpages displayed after the change in the zoom level;

in response to identifying the portion of the one or more webpages displayed after the change in the zoom level and analytics associated with a first object located within the scaled overlays, communicate, during the replay of the one or more application sessions, the analytics associated with the first object from the first object to a second object located in fixed overlays, the fixed overlays being HTML elements that are separate from the scaled overlays and displayed over the webpages such that objects displayed in the fixed overlays and the scaled overlays do not alter objects displayed within the one or more webpages and two-way communication between the scaled overlays and the fixed overlays is enabled by the scaled overlays; and

display, during the replay of the one or more application sessions, reports associated with the analytics in the fixed overlays, wherein a zoom level of the fixed overlays is unaffected by changing the zoom level of the webpages and wherein the reports associated with the analytics are dynamically updated based on the detected change in the zoom level of the one or more webpages and the one or more user inputs entered during the one or more web sessions.

23. The system of claim 22, wherein the computing device is further configured to:

load the webpages;

insert a first set of objects into the webpages, wherein the first set of objects are configured to display a first set of the analytics and adjust a zoom level of the first set of the analytics to correspond with the zoom level of the webpages; and

insert a second set of objects into the webpages, wherein the second set of objects are configured to display a second set of the analytics, and wherein a zoom level of the second set of the analytics is unchanged by changing the zoom level of the webpages.

24. The system of claim 23, wherein the first set of objects display usage clusters and the second set of objects display usage reports for the usage clusters.

25. The system of claim 23, wherein the computing device is further configured to:

insert a third set of objects into the webpages, wherein the third set of objects are configured to display icons configured to control the zoom level of the webpages; and

display the icons within the third set of objects, wherein a zoom level of the icons is unaffected by changing the zoom level of the webpages.