Rendering content on computing systems

• US 9,171,348 B2
• Filed: 09/21/2012
• Issued: 10/27/2015
• Est. Priority Date: 01/23/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kloba, Grace, Qin, Min, Ren, Huan
• Primary Examiner(s): Featherstone, Mark D
• Application Number:
  US13/624,839
• Publication Number:
  US 20150206269A1
• Time in Patent Office: 1,131 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 40/134 Hyperlinking
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2200/28 involving image processing hardware
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04N 21/2335 involving reformatting operations of audio signals, e.g. by converting from one coding standard to another details of audio signal transcoding G10L19/173
• CPC Class Codes: H04N 21/42653 for processing graphics
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/4325 by playing back content from the storage medium reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 7/0122 the input and the output signals having different aspect ratios

Abstract

A computer-implemented method for rendering video content is disclosed according to an aspect of the subject technology. The method comprises retrieving video content from a network, directing the retrieved video content to a video hardware accelerator, wherein the video hardware accelerator renders the video content into rendered video content, and determining whether the video content is to be displayed in an embedded mode or a full screen mode. The method also comprises, if the video content is to be displayed in the embedded mode, then instructing a graphics processing unit (GPU) to composite the rendered video content with other rendered content for display to a user on a display, and, if the video content is to be displayed in the full screen mode, then instructing the video hardware accelerator to send the rendered video content to the display without compositing by the GPU.

Claims

1. A computer-implemented method for rendering video content, the method comprising:

retrieving video content from a network using a uniform resource locator (URL) referenced in a web content area being rendered;

directing the retrieved video content to a video hardware accelerator, wherein the video hardware accelerator renders the video content into rendered video content;

determining whether the video content is to be displayed in an embedded mode or a full screen mode;

if the video content is to be displayed in the embedded mode, then;

instructing the video hardware accelerator to write the rendered video content to a memory space in a graphics processing unit (GPU), and

instructing a GPU process of a web browser to composite the rendered video content in the memory space with rendered content of the web content area for display to a user on a display; and

if the video content is to be displayed in the full screen mode, then instructing the video hardware accelerator to send the rendered video content to the display without compositing by the GPU.

2. The method of claim 1, further comprising:

rendering web content into rendered web content using a render process implemented on a processer, wherein the other rendered content comprises the rendered web content.

3. The method of claim 1, wherein the video hardware accelerator performs video decoding on the video content to produce the rendered video content.

4. The method of claim 1, further comprising:

parsing markup language code of the web content area to determine if the markup language code includes a video tag associated with the URL, the video tag indicating that the URL references video content.

5. The method of claim 1, further comprising:

ceasing instructions to the GPU process to composite the rendered video content with the rendered content of the web content area when the video content is displayed in the full screen mode; and

resuming the ceased instructions to the GPU process when the video content is displayed in the embedded mode.

6. The method of claim 2, further comprising:

if the video content is to be displayed in the embedded mode, then performing the steps of;

sending a render target to the video hardware accelerator, wherein the video hardware accelerator writes the rendered video content to a memory space in the GPU specified by the render target; and

sending the render target to a GPU, wherein the GPU retrieves the rendered video content from the memory space specified by the render target for compositing with the rendered web content.

7. A system for rendering video content, the system comprising:

one or more processors;

a video hardware accelerator;

a graphics processing unit (GPU); and

a machine-readable medium comprising instructions stored therein, which when executed by the one or more processors, cause the one or more processors to perform operations comprising;

retrieving video content from a network using a uniform resource locator (URL) referenced in a web content area being rendered;

directing the retrieved video content to the video hardware accelerator, wherein the video hardware accelerator renders the video content into rendered video content

determining whether the video content is to be displayed in an embedded mode or a full screen mode;

if the video content is to be displayed in the embedded mode, then performing the steps of;

instructing the video hardware accelerator to write the rendered video content to a memory space in the GPU; and

instructing a GPU process of a web browser to composite the rendered video content in the memory space with rendered content of the web content area for display to a user on a display; and

if the video content is to be displayed in the full screen mode, then instructing the video hardware accelerator to send the rendered video content to the display without compositing by the GPU.

8. The system of claim 7, wherein the operations further comprise:

rendering web content into rendered web content using a render process implemented on a processer, wherein the other rendered content comprises the rendered web content.

9. The system of claim 7, wherein the video hardware accelerator performs video decoding on the video content to produce the rendered video content.

10. The system of claim 7, wherein the operations further comprise:

parsing markup language code of the web content area to determine if the markup language code includes a video tag associated with the URL, the video tag indicating that the URL references video content.

11. The system of claim 7, wherein the operations further comprise:

ceasing instructions to the GPU process to composite the rendered video content with the rendered content of the web content area when the video content is displayed in the full screen mode; and

resuming the ceased instructions to the GPU process when the video content is displayed in the embedded mode.

12. The system of claim 8, wherein the operations further comprise:

if the video content is to be displayed in the embedded mode, then performing the steps of;

processing markup language code of a web page to determine an order of the web content and the video content; and

instructing the GPU to composite the rendered web content and the rendered video content based on the determined order.