Determining content layout positions produced by a layout engine

• US 8,458,588 B1
• Filed: 02/25/2011
• Issued: 06/04/2013
• Est. Priority Date: 02/25/2011
• Status: Expired due to Fees

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Morton, Michael S., Faller, Jeremy
• Primary Examiner(s): Mills, Frank D
• Application Number:
  US13/035,666
• Time in Patent Office: 830 Days
• Field of Search: 715/256
• US Class Current: 715/256
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]

Abstract

A position determination module determines positions that components of content—such as individual words of textual content—will have when rendered by a layout engine. Specifically, the position determination module modifies visual attribute values of the content components such that the components when rendered will have different appearances, but the same positions, as they would if rendered without the modified visual attribute values. The position determination module then causes the layout engine to render the content with the modified visual attribute values and identifies the various values of the visual attributes within the rendered content and notes the positions at which they occur. Based on its knowledge of which visual attribute values are associated with which content components, the position determination module in turn associates the positions with the corresponding content components. Thus, positions of content components within rendered images of the content can be determined.

Claims

1. A computer-implemented method for determining positions at which a plurality of content components within original content of a digital publication are rendered by an independent layout engine, comprising:

producing modified content by modifying visual attribute values of the plurality of content components of the original content, the content components of the original content being described by markup tags, the modifying comprising at least one of modifying the markup tags and adding additional markup tags associated with the content components, wherein the modifying does not modify layout positions of the content components of the original content when rendered by the layout engine;

associating the modified visual attribute values with the content components to which they correspond;

producing a modified rendering by rendering the modified content to an offscreen graphics buffer using the layout engine;

identifying changes in pixel values over the modified rendering;

identifying positions of regions within the modified rendering of the offscreen graphics buffer that have the modified visual attribute values, based on the identified changes in pixel values; and

associating the identified positions with content components based on the associations of the modified visual attribute values with the content components.

2. The computer-implemented method of claim 1, further comprising:

producing an unmodified rendering by rendering the original content to an onscreen graphics buffer using the layout engine; and

performing additional rendering with respect to the rendered versions of the components within the unmodified rendering, wherein the additional rendering is based at least in part on the identified positions of the content components.

3. The computer-implemented method of claim 1, wherein the original content comprises textual words and associated formatting characteristics that when rendered by the layout engine produce rendered text, and wherein the content components comprise individual ones of the textual words.

4. The computer-implemented method of claim 1, wherein the identified positions include page numbers of pages on which the content components were rendered in the modified rendering.

5. The computer-implemented method of claim 1, wherein the identified positions include pixel coordinates of locations at which the content components were rendered in the modified rendering.

6. The computer-implemented method of claim 1, wherein modifying visual attribute values of content components of the original content comprises at least one of adding or modifying background colors associated with the content components of the original content.

7. The computer-implemented method of claim 1, wherein identifying changes in pixel values comprises analyzing changes in successive pixel values of a line of pixels in the modified rendering.

8. A non-transitory computer-readable storage medium storing a computer program executable by a processor for determining positions at which a plurality of content components within original content of a digital publication are rendered by an independent layout engine, actions of the computer program comprising:

producing modified content by modifying visual attribute values of the plurality of content components of the original content, the content components of the original content being described by markup tags, the modifying comprising at least one of modifying the markup tags and adding additional markup tags associated with the content components, wherein the modifying does not modify layout positions of the content components of the original content when rendered by the layout engine;

associating the modified visual attribute values with the content components to which they correspond;

producing a modified rendering by rendering the modified content to an offscreen graphics buffer using the layout engine;

identifying changes in pixel values over the modified rendering;

identifying positions of regions within the modified rendering of the offscreen graphics buffer that have the modified visual attribute values, based on the identified changes in pixel values; and

associating the identified positions with content components based on the associations of the modified visual attribute values with the content components.

9. The non-transitory computer-readable storage medium of claim 8, the actions of the computer program further comprising:

producing an unmodified rendering by rendering the original content to an onscreen graphics buffer using the layout engine; and

performing additional rendering with respect to the rendered versions of the components within the unmodified rendering, wherein the additional rendering is based at least in part on the identified positions of the content components.

10. The non-transitory computer-readable storage medium of claim 8, wherein the original content comprises textual words and associated formatting characteristics that when rendered by the layout engine produce rendered text, and wherein the content components comprise individual ones of the textual words.

11. The non-transitory computer-readable storage medium of claim 8, wherein the identified positions include page numbers of pages on which the content components were rendered in the modified rendering.

12. The non-transitory computer-readable storage medium of claim 8, wherein identifying changes in pixel values comprises analyzing changes in successive pixel values of a line of pixels in the modified rendering.

13. A computer system for determining positions at which a plurality of content components within original content of a digital publication are rendered by an independent layout engine, the system comprising:

a computer processor; and

a computer program executable by the computer processor and performing actions comprising;

modifying visual attribute values of the plurality of content components of the original content, thereby producing modified content, the content components of the original content being described by markup tags, the modifying comprising at least one of modifying the markup tags and adding additional markup tags associated with the content components, wherein the modifying does not modify layout positions of the content components of the original content when rendered by the layout engine;

associating the modified visual attribute values with the content components to which they correspond;

producing a modified rendering by rendering the modified content to an offscreen graphics buffer using the layout engine;

identifying changes in pixel values over the modified rendering;

identifying positions of regions within the modified rendering of the offscreen graphics buffer that have the modified visual attribute values, based on the identified changes in pixel values; and

associating the identified positions with content components based on the associated of the modified visual attribute values with the content components.

14. The computer system of claim 13, the actions of the computer program further comprising:

producing an unmodified rendering by rendering the original content to an onscreen graphics buffer using the layout engine; and

performing additional rendering with respect to the rendered versions of the components within the unmodified rendering, wherein the additional rendering is based at least in part on the identified positions of the content components.

15. The computer system of claim 13, wherein the original content comprises textual words and associated formatting characteristics that when rendered by the layout engine produce rendered text, and wherein the content components comprise individual ones of the textual words.

16. The computer system of claim 13, wherein the identified positions include page numbers of pages on which the content components were rendered in the modified rendering.

17. The computer system of claim 13, wherein identifying changes in pixel values comprises analyzing changes in successive pixel values of a line of pixels in the modified rendering.