Collecting client-side performance metrics and latencies

• US 8,266,281 B1
• Filed: 04/22/2010
• Issued: 09/11/2012
• Est. Priority Date: 04/22/2010
• Status: Active Grant

• Current Assignee: IMDb.com, Inc. (Amazon.com, Inc.)
• Original Assignee: IMDb.com, Inc. (Amazon.com, Inc.)
• Inventors: Carlson, Adam, Lee, Joseph C., Kerzhner, Olia, Berg, Andrew C.
• Primary Examiner(s): Nguyen, Quang N.
• Application Number:
  US12/765,178
• Time in Patent Office: 873 Days
• Field of Search: 709/203, 709/217, 709/219, 709/223, 709/224
• US Class Current: 709/224
• CPC Class Codes: G06F 11/3419 by assessing time
• CPC Class Codes: G06F 11/3495 for systems
• CPC Class Codes: G06F 2201/81 Threshold
• CPC Class Codes: G06F 2201/83 the solution involving signatures
• CPC Class Codes: G06F 2201/835 Timestamp
• CPC Class Codes: G06F 2201/86 Event-based monitoring
• CPC Class Codes: G06F 2201/875 Monitoring of systems including the internet
• CPC Class Codes: G06F 2201/88 Monitoring involving counting
• CPC Class Codes: H04L 43/0876 Network utilisation, e.g. volume of load or congestion level

Abstract

Technologies are described herein for collecting client-side performance metrics and latencies. A web page received by a web browser application executing on a user computing device includes markup or scripting code that instructs the browser to collect performance measures during the rendering of the content of the web page. The performance measures may include operation timings that measure the time it takes for a particular operation to complete during the rendering of the content and/or event counters that count the number of times that a specific event occurs during the rendering of the content. The web browser application sends an event report containing the collected performance measures to a reporting module executing on a server computer. The reporting module receives the event report, validates the content of the event report, and adds the event report to a database or other data storage system.

Claims

1. A computer-implemented method for collecting client-side performance measures during rendering of content from a markup file at a user computing device, the method comprising performing instructions under the control of a computer system for:

receiving an event report from the user computing device, wherein the event report comprises one or more of an operation timing specifying a duration of execution of an identified operation during the rendering of the content or an event counter specifying a number of times that an identified event occurred during the rendering of the content;

upon receiving the event report, validating the event report by verifying a value of a signature key and a timestamp contained in the event report, the signature key being computed from the timestamp and a secret code and embedded in the markup file before the markup file is sent to the user computing device, and wherein verifying the value of the signature key comprises re-computing a second signature key from the timestamp in the event report and the secret code and verifying that the signature key in the event report matches the second signature key; and

upon validating the event report, storing the event report in a database.

2. The computer-implemented method of claim 1, where the one or more of the operation timing or the event counter are collected by a client application executing on the user computing device according to scripting language code provided in the markup file.

3. The computer-implemented method of claim 1, wherein the operation timing comprises a specification of the duration of a call by the user computing device to an external server to retrieve additional content.

4. The computer-implemented method of claim 1, wherein the event counter comprises the specification of a number of calls to external servers to retrieve additional content that returned no data.

5. The computer-implemented method of claim 1, wherein the signature key comprises a hash-based message authentication code computed from the timestamp and the secret code.

6. The computer-implemented method of claim 1, wherein the timestamp indicates an approximate time of the rendering of the content at the user computing device, and wherein validating the event report further comprises verifying that the event report contains recently collected performance measures based on the timestamp.

7. The computer-implemented method of claim 1, wherein the event report comprises geolocation data regarding the user computing device.

8. A non-transitory computer-readable storage medium having computer-executable instructions stored thereon that, when executed by a computer, cause the computer to:

receive an event report from a user computing device, the event report comprising a signature key, a timestamp, and one or more performance measures collected during rendering of content in a markup file to a display connected to the user computing device, wherein the one or more performance measures are collected by an application executing on the user computing device according to scripting language code provided in the markup file and wherein the signature key is computed from the timestamp and a secret code and embedded in the markup file before the markup file is sent to the user computing device;

upon receiving the event report, validate the event report by verifying a value of the signature key, wherein verifying the value of the signature key comprises re-computing a second signature key from the timestamp in the event report and the secret code and verifying that the signature key in the event report matches the second signature key; and

upon validating the event report, store the event report in a data storage system.

9. The computer-readable storage medium of claim 8, wherein the one or more performance measures in the event report comprises an operation timing specifying a duration of execution of an identified operation during the rendering of the content.

10. The computer-readable storage medium of claim 9, wherein the operation timing comprises a specification of the duration of a call by the user computing device to an external server to retrieve additional content to render on the display.

11. The computer-readable storage medium of claim 8, wherein the one or more performance measures in the event report comprises an event counter specifying a number of times that an identified event occurred during the rendering of the content.

12. The computer-readable storage medium of claim 11, wherein the event counter comprises the specification of a number of calls to external servers to retrieve additional content that returned no data.

13. The computer-readable storage medium of claim 8, wherein the event report comprises a timestamp indicating an approximate time of the rendering of the content at the user computing device, and wherein validating the event report further comprises verifying that the event report contains recently collected performance measures based on the timestamp.

14. The computer-readable storage medium of claim 8, wherein the event report comprises geolocation data regarding the user computing device.

15. The computer-readable storage medium of claim 8, wherein multiple event reports are received from the user computing device regarding the rendering of the content to the display.

16. The computer-readable storage medium of claim 8, wherein the event report is sent by the application executing on the user computing device at a point relative to a critical period in the rendering of the content in the markup file and before the rendering of the content in the markup file is completed.

17. The computer-readable storage medium of claim 16, wherein the event report includes all performance measures collected by the application executing on the user computing device during the rendering of the content in the markup file prior to the point relative to the critical period.

18. A system for collecting client-side performance measures during rendering of content at a user computing device, the system comprising:

a web server configured to transmit a web page to a web browsing application executing on the user computing device, the web page comprising instructions that cause the web browsing application to collect performance measures during the rendering of the content; and

a reporting service module executing on a server computer operably connected to the user computing device and configured to

receive an event report from the user computing device, wherein the event report comprises a signature key, a timestamp, and the performance measures collected by the web browsing application during the rendering of the content, wherein the signature key is computed from the timestamp and a secret code and embedded in the web page before the web page is sent to the user computing device,

upon receiving the event report, validate the event report by verifying a value of the signature key contained in the event report, wherein verifying the value of the signature key comprises re-computing a second signature key from the timestamp in the event report and the secret code and verifying that the signature key in the event report matches the second signature key, and

upon validating the event report, store the event report in a data storage system.

19. The system of claim 18, wherein the performance measures in the event report comprises one or more of an operation timing specifying a duration of execution of an identified operation during the rendering of the content or an event counter specifying a number of times that an identified event occurred during the rendering of the content.

20. The system of claim 18, wherein the event report comprises geolocation data regarding the user computing device.

21. A computer-implemented method for collecting client-side performance measures during rendering of content at a user computing device, the method comprising performing instructions under the control of a computer system for:

sending a markup file to the user computing device, the markup comprising a signature key, a timestamp, and instructions that cause a client application executing on the user computing device to collect performance measures during the rendering of the content, the signature key being computed from the timestamp and a secret code before the markup file is sent to the user computing device;

receiving an event report from the user computing device, wherein the event report comprises the signature key, the timestamp, and the performance measures collected by the client application during the rendering of the content;

upon receiving the event report, validating the event report by re-computing a second signature key from the timestamp in the event report and the secret code and verifying that the signature key in the event report matches the second signature key; and

upon validating the event report, storing the event report in a data storage system.

22. The computer-implemented method of claim 21, wherein the performance measures in the event report comprise one or more of an operation timing specifying a duration of execution of an identified operation during the rendering of the content or an event counter specifying a number of times that an identified event occurred during the rendering of the content.