System and Method for Processing Graphics Operations with Graphics Processing Unit

• US 20110187736A1
• Filed: 04/05/2011
• Published: 08/04/2011
• Est. Priority Date: 04/16/2004
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Zimmer, Mark
• Granted Patent: US 8,009,176 B2
• Time in Patent Office: Days
• US Class Current: 345/589
• CPC Class Codes: G06F 9/45504 Abstract machines for programme code execution, e.g. Java virtual machine [JVM], interpreters, emulators
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

Disclosed is a system and method for processing graphic operations on a plurality of data structures of an image with a graphics processing unit and memory. The disclosed techniques of the system and method create an accumulation buffer of the data structures for accumulating changes to the data structures. A separate buffer is then created from at least a portion of the data structures of the accumulation buffer. The disclosed techniques read the data structures from the separate buffer with the graphics processing unit. The graphics processing unit operates on the data structures read from the separate buffer with the operation. Then, the disclosed techniques write the results of the operation onto the portion of the accumulation buffer corresponding to the separate buffer.

Claims

1. A method of generating an output on a computer display, the method comprising:

a) creating a context in a memory;

b) obtaining an image, the image being in a first color space;

c) defining a first filter to change a first image'"'"'s color space from the first color space to a second color space, wherein the first and second color spaces are distinct;

d) defining a second filter set to perform a function, the second filter set accepting as input a second image and at least one input parameter, the function being at least one of cropping, flipping, rotating, scaling, positioning, and blending;

e) defining a third filter to change the color space of a third image to a third color space;

f) applying the first filter to the image to generate the second image;

g) applying the second filter set to the second image to generate the third image;

h) applying the third filter to the third image to generate a result image;

i) rendering the result image to the context; and

j) displaying the result image on a display, wherein the acts (a) through (i) are performed using a single application programming interface (API).

2. The method of claim 1, wherein the act of obtaining an image, comprises obtaining an image from an application program.

3. The method of claim 1, wherein the second filter set comprises one or more filters.

4. The method of claim 1, wherein at least one of the first filter, second filter set and third filters comprise at least one filter pre-defined in the API.

5. The method of claim 1, wherein the act of applying the second filter set is performed by a graphics processing unit (GPU).

6. The method of claim 5 wherein the API enables the performance of acts (a) through (i) without a user of the API defining an OpenGL state and without a user of the API utilizing assembly language for programming the GPU.

7. The method of claim 1, wherein the act of applying the first filter is performed before the act of defining the second filter set.

8. The method of claim 1, wherein the act of applying one or more of the first filter, second filter set and third filters comprise optimizing the one or more filters before the act of applying.

9. The method of claim 8, wherein the act of optimizing is performed by a central processing unit.

10. The method of claim 9, wherein the act of optimizing uses one or more of the following techniques:

caching of intermediary results, limiting computation and storage to a domain of definition, limiting computation and storage to a region of interest, and graph re-writing.

11. The method of claim 1 wherein the API makes use of OpenGL functions.

12. The method of claim 1, wherein the API comprises an OpenGL library.

13. The method of claim 1, wherein the first color space and the third color space are the same color space.

21. A computer system comprising:

one or more displays;

memory; and

one or more processors operatively coupled to the one or more displays and the memory, the memory having stored therein instructions executable by the one or more processors for performing the method of claim 1.

23. A program storage device, readable by one or more programmable control devices, comprising instructions stored thereon for causing the one or more programmable control devices to perform the method of claim 1.

14. A method of generating an output on a computer display, the method comprising:

a) obtaining an image, the image having a first color space;

b) identifying a first filter to change the first color space of a first image to a second color space;

c) identifying one or more second filters to perform, on a second image, at least one of cropping, flipping, rotating, scaling, positioning, and blending;

d) identifying a third filter to change the color space of a third image to a third color space;

e) applying the first filter to the image to generate the second image;

f) applying the one or more second filters to the second image to generate the third image;

g) applying the third filter to the third image to generate a result image;

h) rendering the result image to a memory; and

i) displaying the result image on a display, wherein the acts (a) through (h) are performed using a single application programming interface (API).

15. The method of claim 14, wherein the first and third color spaces are the same color space.

16. The method of claim 14, wherein the act of applying the one or more second filters is performed by a graphics processing unit.

17. The method of claim 14, wherein at least one of the first filter, one or more second filters and third filters comprise at least one filter pre-defined in the API.

18. The method of claim 14 wherein the act of identifying one or more of the first filter, one or more second filters and third filter comprises creating the one or more filters.

19. The method of claim 14, wherein the API comprises an OpenGL library.

20. The method of claim 14, wherein the act of rendering the result image to a memory comprises rendering the result image into a context.

22. A computer system comprising:

one or more displays;

memory; and

one or more processors operatively couple to the one or more displays and the memory, the memory having stored therein instructions executable by the one or more processors for performing the method of claim 14.

24. A program storage device, readable by one or more programmable control devices, comprising instructions stored thereon for causing the one or more programmable control devices to perform the method of claim 14.