Systems and methods for rendering documents

• US 8,812,946 B1
• Filed: 10/17/2011
• Issued: 08/19/2014
• Est. Priority Date: 10/17/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kopylov, Igor, Frederick, Michael
• Primary Examiner(s): DYER, ANDREW R
• Application Number:
  US13/275,093
• Time in Patent Office: 1,037 Days
• Field of Search: 715/202, 715/205, 715/209, 715/234, 715/235, 715/236, 715/239
• US Class Current: 715/202
• CPC Class Codes: G06F 40/10 Text processing natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]

Abstract

Generally, the systems and methods described herein are directed to rendering a document containing textual elements and graphical elements. The systems and methods include separating the graphical elements from the textual elements, and generating a bitmap rendering of the graphical elements and an HTML rendering of the textual elements. The HTML rendering may then be overlaid on the bitmap rendering to generate a composite document having textual elements that are accessible to screen reader software.

Claims

1. A computerized method for generating an online collaborative editable document to be rendered by a web browser, comprising:

receiving, at a server, a raw online collaborative editable document, having one or more data objects including one or more graphical elements and one or more textual elements, wherein the raw online collaborative editable document is configured to be rendered in a graphical format in a web browser and the raw document includes one or more presentation slides, one or more spreadsheets, or one or more word-processing document pages;

identifying, at the server, the one or more graphical elements from the raw document, and generating a graphical data file including the one or more identified graphical elements;

identifying, at the server, the one or more textual elements from the raw document, and generating a textual data file including the one or more identified textual elements, wherein the textual data file includes Hypertext Markup Language (HTML) data and Cascading Style Sheets (CSS) data, wherein generating the textual data file including the one or more textual elements includes identifying the one or more textual elements in the document and generating the textual data file having HTML data and CSS data representative of content and appearance of only the one or more identified textual elements;

identifying, at the server, alignment of the one or more graphical elements and alignment of the one or more textual elements;

adding, at the server, HTML and CSS data to the textual data file to include the graphical data file, thereby generating a composite document, wherein the CSS data aligns graphical elements with textual elements matching the alignment of the one or more graphical elements and the one or more textual elements in the raw document; and

wherein, when rendered by the web browser, the textual data file overlays the graphical data file such that alignment, content and appearance of one or more graphical elements and one or more textual elements of the composite document are the same as the alignment, content and appearance of the one or more graphical elements and the one or more textual elements of the raw document.

2. The computerized method of claim 1, further comprising sending the raw document from at least one of a stored remote database and the client computing device.

3. The computerized method of claim 1, wherein the graphical elements include non-textual elements including at least one of shapes, images, audio and video.

4. The computerized method of claim 1, wherein generating the graphical data file including the graphical elements includes generating at least one of a vector image file, a bitmap image file, a compressed image file, an audio file, and a video file.

5. The computerized method of claim 1, wherein generating the graphical data file includes identifying the one or more graphical elements in the document and generating a graphical data file including only the one or more graphical elements.

6. The computerized method of claim 1, further comprising generating a vector data file including the one or more graphical elements and the one or more textual elements rendered as a scalable vector graphics (SVG) file.

7. The computerized method of claim 1, wherein the graphical elements are combined with the textual elements such that when viewing the document, the graphical elements and textual elements overlap.

8. The computerized method of claim 1, further comprising sending the composite document from the server to a web browser at a client computing device.

9. The computerized method of claim 1, further comprising allowing a user, at a client computing device, to submit a request to make the raw document screen reader accessible, and in response to the user request sending the composite document to the client computing device.

10. A server-based system for generating an online collaborative editable document, comprising:

a server comprising a processor configured to;

receive a raw online collaborative editable document having one or more data objects including one or more graphical elements and one or more textual elements, wherein the raw online collaborative editable document is configured to be rendered in a graphical format in a web browser and the raw document includes one or more presentation slides, one or more spreadsheets, or one or more word-processing document pages;

identify, the one or more graphical elements from the raw document, and generate a graphical data file including the one or more identified graphical elements;

identify, the one or more textual elements from the raw document, and generate a textual data file including the one or more identified textual elements, wherein the textual data file includes Hypertext Markup Language (HTML) data and Cascading Style Sheets (CSS) data, wherein generating the textual data file including the one or more textual elements includes identifying the one or more textual elements in the document and generating the textual data file having HTML data and CSS data representative of content and appearance of only the one or more identified textual elements;

identify an alignment of the one or more graphical elements and an alignment of the one or more textual elements;

add HTML and CSS data to the textual data file to include the graphical data file, thereby generating a composite document, wherein the CSS data aligns graphical elements with textual elements matching the alignment of the one or more graphical elements and the one or more textual elements in the raw document; and

wherein, when rendered by the web browser, the textual data file overlays the graphical data file such that alignment, content and appearance of one or more graphical elements and one or more textual elements of the composite document are the same as the alignment, content and appearance of the one or more graphical elements and the one or more textual elements of the raw document.

11. A computerized method for rendering an online collaborative editable document, comprising:

receiving, at a client computing device, a user request for displaying a raw online collaborative editable document having one or more graphical elements and one or more textual elements, wherein the raw online collaborative editable document is configured to be rendered in a graphical format in a web browser and the raw document includes at least one of a presentation slide, a spreadsheet and a word-processing document page, and wherein the user request is received via a web-application installed on the client computing device;

retrieving, at the client computing device, a composite document having HTML data and CSS data representative of the one or more graphical elements and the one or more textual elements, wherein the CSS data aligns graphical elements with textual elements matching the alignment of the one or more graphical elements and the one or more textual elements in the raw document; and

rendering the composite document in a web browser on the client computing device;

wherein the composite document includes a combination of a graphical data file and a textual data file, the composite document including the textual data file having additional data to including the graphical data file, wherein the textual data file includes the one or more textual elements in the document and includes HTML data and CSS data representative of content and appearance of only the one or more identified textual elements; and

wherein when rendered by the web browser, the textual data file overlays the graphical data file such that alignment, content and appearance of one or more graphical elements and one or more textual elements of the composite document are the same as the alignment, content and appearance of the one or more graphical elements and the one or more textual elements of the raw document.

12. The computerized method of claim 11, wherein the web-application includes at least one of an online document processing application, and an online presentation application.

13. The computerized method of claim 11, further comprising creating the raw document at the client computing device using a web application.

14. The computerized method of claim 11, further comprising storing the raw document in the client computing device.

15. The computerized method of claim 11, further comprising sending the raw document from the client computing device to a server for storage.

16. The computerized method of claim 11, wherein the user request includes a request to display the raw document in a format suitable for screen readers.

17. The computerized method of claim 11, wherein the user request includes a selection of an icon made available to the user via a web browser on the client computing device.

18. The computerized method of claim 11, wherein retrieving the composite document includes receiving the composite document from a server.

19. The computerized method of claim 11, further comprising sending the composite document to a screen reader application on the client computing device.

20. The computerized method of claim 19, further comprising rendering the composite document in the screen reader application on the client computing device.