Determining visibility of rendered content

• US 9,478,042 B1
• Filed: 08/12/2014
• Issued: 10/25/2016
• Est. Priority Date: 08/12/2014
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Khandpur, Sundeep Singh
• Primary Examiner(s): Sajous, Wesner
• Application Number:
  US14/458,082
• Time in Patent Office: 805 Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 30/0242 Determining effectiveness of advertisements
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30242 Counting objects in image
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume
• CPC Class Codes: G06T 7/90 Determination of colour characteristics

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining whether content rendered on a display is actually visible to a user. In one aspect, a method includes generating and transmitting content presentation data that causes a user device to present, at a display and over a first time period, a content item that includes one or more content portions that are each designated for presentation in a respective first color. For a second time period, the respective first color of a particular content portion is changed to a second color. Visual representation data that includes a visual representation of the display during the second time period is generated and provided. Using the visual representation, an amount of the content item that was visible at the display is determined based on an amount of the particular content portion presented in the second color.

Claims

1. A system, comprising:

a data processing apparatus; and

a memory apparatus in data communication with the data processing apparatus and storing instructions executable by the data processing apparatus and that upon such execution cause the data processing apparatus to perform operations comprising;

generating and transmitting content presentation data comprising a content item and instructions to a user device;

receiving a visual representation of a display of the user device consequent to execution of the instructions by the user device, the received visual representation depicting the display during a temporary state in which a portion of the content item that is designated for presentation in a first color is presented in a second color different from the first color; and

determining, using the received visual representation, an amount of the content item visible at the display based on an amount of the portion of the content item that was presented in the second color.

2. The system of claim 1, wherein determining the amount of the content item visible at the display comprises:

identifying a first number of pixels of the content portions changed to the second color;

determining, using the visual representation, a second number of pixel-sized areas that were presented in the second color; and

determining the amount of the content item that was visible at the display based on a comparison of the first number to the second number.

3. The system of claim 1, wherein determining the amount of the content item that was visible at the display comprises:

identifying in the visual representation an expected presentation location of the portion of the content item; and

determining a number of pixel-sized areas in the expected presentation location that match the second color for the portion of the content item.

4. The system of claim 1, wherein the content item comprises an advertisement, the operations further comprising:

determining that the amount of the advertisement visible at the display satisfies a specified visibility threshold; and

generating and transmitting data that indicates that an impression of the advertisement occurred in response to determining that the amount of the content item that was visible at the display satisfies the specified visibility threshold.

5. The system of claim 1, wherein the operations further comprise:

receiving multiple visual representations from the user device, each of the multiple visual representations associated with a timestamp specifying a time at which each of the multiple visual representations was obtained;

determining that one or more of the visual representations include at least a specified amount of the content item; and

determining an amount of time that the content item was visible based on the timestamps for each of the one or more visual representations that include at least the specified amount of the content item.

6. The system of claim 5, wherein the operations further comprise generating and transmitting data to the user device that causes the user device to delete the content item in response to determining that the amount of the content item that was visible at the display satisfies a specified visibility threshold and the amount of time the content item was visible satisfies a specified time threshold.

7. The system of claim 1, wherein the second color of the portion of the content item in the received visual representation is created consequent to execution of the instructions by the user device, the instructions comprising adjusting one or more RGB color values that define the first color for the portion of the content item to produce the second color.

17. The method of claim 1, wherein execution of the instructions causes the user device to change, after the temporary state of the display, the portion of the content item back to the second color.

18. The method of claim 1, wherein the visual representation of the display comprises data from an off screen buffer of the user device designated for presentation at the display.

8. A non-transitory computer storage medium encoded with a computer program, the program comprising instructions that when executed by a data processing apparatus cause the data processing apparatus to perform operations comprising:

generating and transmitting content presentation data comprising a content item and instructions that causes a user device upon execution of the further instructions to;

present, at a display and over a first time period, the content item that includes a content portion that is designated for presentation in a respective first color for the content portion;

change, for a second time period that is after the first time period, the first color of the content portion to a second color that is different from the first color of the content portion; and

generate and provide visual representation data that includes a visual representation of the display during the second time period in which the first color of the content portion is changed to the second color, the visual representation data being provided in response to receiving the content presentation data;

receiving the visual representation data from the user device consequent to execution of the instructions by the user device; and

determining, using the visual representation, an amount of the content item that was visible at the display based on an amount of the content portion presented in the second color.

9. A method performed by a data processing apparatus, the method comprising:

generating and transmitting content presentation data comprising a content item and instructions to a user device;

receiving a visual representation of a display of the user device consequent to execution of the instructions by the user device, the received visual representation depicting the display during a temporary state in which a portion of the content item that is designated for presentation in a first color is presented in a second color different from the first color;

identifying a first number of pixels of the content portion changed to the second color;

determining, using the visual representation, a second number of pixel-sized areas that were presented in the second color; and

determining, using the received visual representation, an amount of the content item that was visible at the display based on an amount of the portion of the content item that was presented in the second color.

10. The method of claim 9, wherein determining the amount of the content item that was visible at the display further comprises:

identifying in the visual representation an expected presentation location of the portion of the content item; and

determining a number of pixel-sized areas in the expected presentation location that match the second color for the content portion.

11. The method of claim 9, wherein the content item comprises an advertisement, the method further comprising:

determining that the amount of the advertisement that was visible at the display satisfies a specified visibility threshold; and

generating and transmitting data that indicates that an impression of the advertisement occurred in response to determining that the amount of the content item that was visible at the display satisfies the specified visibility threshold.

12. The method of claim 9, wherein the method further comprises:

receiving multiple visual representations from the user device, each particular visual representation being obtained at different times and being associated with a timestamp that specifies a time at which the particular visual representation was captured;

determining that one or more of the visual representations include at least a specified amount of the content item; and

determining an amount of time that the content item was visible based on the timestamps for each of the one or more visual representations that include at least the specified amount of the content item.

13. The method of claim 12, wherein the method further comprises generating and sending data to the user device that causes the user device to delete the content item in response to determining that the amount of the content item that was visible at the display satisfies a specified visibility threshold and the amount of time the content item was visible satisfies a specified time threshold.

14. The method of claim 9, wherein the second color of the portion of the content item in the received visual representation was created consequent to execution of the instructions by the user device, the instructions comprising adjusting one or more RGB color values that define the first color for the portion of the content item to produce the second color.

15. The method of claim 14, wherein each of the one or more RGB color values is adjusted by a specified amount.

16. The method of claim 9, wherein generating the visual representation comprises capturing a screenshot of an area of the display in which the content item is presented.