Method and system for sharing a buffer between a graphics processing unit and a media encoder

• US 8,928,680 B1
• Filed: 07/10/2012
• Issued: 01/06/2015
• Est. Priority Date: 07/10/2012
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Sanketi, Pannag Raghunath, Gennis, Jamie
• Primary Examiner(s): Crawford, Jacinta M
• Application Number:
  US13/545,870
• Time in Patent Office: 910 Days
• Field of Search: 345/530, 345/531, 345/541, 345/543, 345/544, 345/503
• US Class Current: 345/543
• CPC Class Codes: G06F 9/5011 the resources being hardware resources other than CPUs, Servers and Terminals
• CPC Class Codes: G06T 1/60 Memory management

Abstract

A program module executing in a first process space of a mobile computing device receives a buffer request from a graphics driver running in a second process space of the mobile computing device, wherein the second process space is isolated from the first process space. The program module assigns a buffer to the graphics driver to store image data processed by a graphical processing unit (GPU) controlled by the graphics driver. The program module receives a release of the buffer from the graphics driver. The program module assigns the buffer to a media encoder driver for a hardware media encoder to encode the image data in the buffer into a file.

Claims

1. A method comprising:

receiving, by a program module executing in a first process space of a mobile computing device, a buffer request from a graphics driver running in a second process space of the mobile computing device, wherein the second process space is isolated from the first process space;

assigning, by the program module, a buffer to the graphics driver to store image data processed by a graphical processing unit (GPU) controlled by the graphics driver;

receiving, by the program module, a release of the buffer from the graphics driver; and

assigning the buffer to a media encoder driver for a hardware media encoder to encode the image data in the buffer into a file.

2. The method of claim 1, wherein the hardware media encoder encodes the processed image data generated by the GPU without any copies of the processed image data having been created.

3. The method of claim 1, wherein assigning the buffer to the graphics driver comprises passing a buffer handle for the buffer to the graphics driver across process space boundaries, and wherein assigning the buffer to the media encoder driver comprises passing the buffer handle to the encoder driver.

4. The method of claim 3, wherein passing the buffer handle to the media encoder driver comprises writing the buffer handle to an additional buffer associated with the media encoder driver.

5. The method of claim 3, wherein passing the buffer handle across the process space boundaries comprises instructing, by the program module, an operating system kernel to grant the graphics driver access to the buffer handle.

6. The method of claim 1, wherein the GPU and the hardware media encoder are pipelined, and wherein the hardware media encoder processes a frame while the GPU processes a next frame.

7. The method of claim 1, wherein the image data does not specify a color space, and wherein the GPU or the hardware media encoder converts the color space from a first color space supported by the GPU to a second color space supported by the media encoder.

8. A non-transitory computer readable storage medium having instructions that, when executed by a mobile computing device, cause the mobile computing device to perform a method comprising:

receiving, by a program module executing in a first process space of the mobile computing device, a buffer request from a graphics driver running in a second process space of the mobile computing device, wherein the second process space is isolated from the first process space;

assigning, by the program module, a buffer to the graphics driver to store image data processed by a graphical processing unit (GPU) controlled by the graphics driver;

receiving, by the program module, a release of the buffer from the graphics driver; and

assigning the buffer to a media encoder driver for a hardware media encoder to encode the image data in the buffer into a file.

9. The computer readable storage medium of claim 8, wherein the hardware media encoder encodes the processed image data generated by the GPU without any copies of the processed image data having been created.

10. The computer readable storage medium of claim 8, wherein assigning the buffer to the graphics driver comprises passing a buffer handle for the buffer to the graphics driver across process space boundaries, and wherein assigning the buffer to the media encoder driver comprises passing the buffer handle to the encoder driver.

11. The computer readable storage medium of claim 10, wherein passing the buffer handle to the media encoder driver comprises writing the buffer handle to an additional buffer associated with the media encoder driver.

12. The computer readable storage medium of claim 10, wherein passing the buffer handle across the process space boundaries comprises instructing, by the program module, an operating system kernel to grant the graphics driver access to the buffer handle.

13. The computer readable storage medium of claim 8, wherein the GPU and the hardware media encoder are pipelined, and wherein the hardware media encoder processes a frame while the GPU processes a next frame.

14. The computer readable storage medium of claim 8, wherein the image data does not specify a color space, and wherein the GPU or the hardware media encoder converts the color space from a first color space supported by the GPU to a second color space supported by the media encoder.

15. A mobile computing device comprising:

a graphics processing unit (GPU);

a hardware media encoder; and

a processing device, coupled to the GPU and the hardware media encoder, configured to receive, at a program module executing in a first process space of the mobile computing device, a buffer request from a graphics driver for the GPU running in a second process space of the mobile computing device, wherein the second process space is isolated from the first process space;

assign, from the first process space, a buffer to the graphics driver to store image data processed by the GPU;

receive, at the program module, a release of the buffer from the graphics driver; and

assign the buffer to a media encoder driver for the hardware media encoder to encode the image data in the buffer into a file.

16. The mobile computing device of claim 15, wherein the hardware media encoder encodes the processed image data generated by the GPU without any copies of the processed image data having been created.

17. The mobile computing device of claim 15, wherein assigning the buffer to the graphics driver comprises passing a buffer handle for the buffer to the graphics driver across process space boundaries, and wherein assigning the buffer to the media encoder driver comprises passing the buffer handle to the encoder driver.

18. The mobile computing device of claim 17, wherein passing the buffer handle to the media encoder driver comprises writing the buffer handle to an additional buffer associated with the media encoder driver.

19. The mobile computing device of claim 17, wherein passing the buffer handle across the process space boundaries comprises instructing, by the program module, an operating system kernel to grant the graphics driver access to the buffer handle.

20. The mobile computing device of claim 15, wherein the GPU and the hardware media encoder are pipelined, and wherein the hardware media encoder processes a frame while the GPU processes a next frame.

21. The mobile computing device of claim 15, wherein the image data does not specify a color space, and wherein the GPU or the hardware media encoder converts the color space from a first color space supported by the GPU to a second color space supported by the media encoder.