System and method for processing graphics operations with graphics processing unit

• US 8,520,021 B2
• Filed: 07/13/2011
• Issued: 08/27/2013
• Est. Priority Date: 04/16/2004
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Zimmer, Mark
• Primary Examiner(s): Yang, Ryan R
• Application Number:
  US13/181,913
• Publication Number:
  US 20120287149A1
• Time in Patent Office: 776 Days
• Field of Search: 345581-605, 345619-672
• US Class Current: 345/589
• CPC Class Codes: G06F 9/45504 Abstract machines for programme code execution, e.g. Java virtual machine [JVM], interpreters, emulators
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

Disclosed is a system and method for processing graphic operations on a plurality of data structures of an image with a graphics processing unit and memory. The disclosed techniques of the system and method create an accumulation buffer of the data structures for accumulating changes to the data structures. A separate buffer is then created from at least a portion of the data structures of the accumulation buffer. The disclosed techniques read the data structures from the separate buffer with the graphics processing unit. The graphics processing unit operates on the data structures read from the separate buffer with the operation. Then, the disclosed techniques write the results of the operation onto the portion of the accumulation buffer corresponding to the separate buffer.

Claims

1. A method of generating an output on a computer display, the method comprising:

a) creating a context in a memory;

b) obtaining a first image, the first image being in a first color space;

c) defining a first filter to change the first image'"'"'s color space from the first color space to a second color space, wherein the first and second color spaces are distinct;

d) defining a second filter set to perform a function, the second filter set accepting as input a second image and at least one input parameter;

e) defining a third filter to change the color space of a third image to a third color space;

f) applying the first filter to the first image to generate the second image;

g) applying the second filter set to the second image to generate the third image;

h) applying the third filter to the third image to generate a result image;

i) rendering the result image to the context; and

j) displaying the result image on a display.

2. The method of claim 1, wherein the act of obtaining a first image, comprises obtaining a first image from an application program.

3. The method of claim 1, wherein the second filter set comprises one or more filters.

4. The method of claim 1, wherein at least one of the first filter, second filter set and third filters comprise at least one filter pre-defined in an application programming interface (API).

5. The method of claim 1, wherein the act of applying the second filter set is performed by a graphics processing unit (GPU).

6. The method of claim 5 wherein an application programming interface (API) enables the performance of acts (a) through (i) without a user of the API defining an OpenGL state and without a user of the API utilizing assembly language for programming the GPU.

7. The method of claim 1, wherein the act of applying the first filter is performed before the act of defining the second filter set.

8. The method of claim 1, wherein the act of applying one or more of the first filter, second filter set and third filters comprise optimizing the one or more filters before the act of applying.

9. The method of claim 8, wherein the act of optimizing is performed by a central processing unit.

10. The method of claim 9, wherein the act of optimizing uses one or more of the following techniques:

caching of intermediary results, limiting computation and storage to a domain of definition, limiting computation and storage to a region of interest, and graph re-writing.

11. The method of claim 1, wherein the acts (a) through (i) are performed using one or more application programming interfaces (APIs), and wherein at least one of the APIs makes use of OpenGL functions.

12. The method of claim 1, wherein the acts (a) through (i) are performed using one or more application programming interfaces (APIs), and wherein at least one of the APIs comprises an OpenGL library.

13. The method of claim 1, wherein the first color space and the third color space are the same color space.

14. A computer system comprising:

one or more displays;

memory; and

one or more processors operatively coupled to the one or more displays and the memory, the memory having stored therein instructions executable by the one or more processors for performing the method of claim 1.

15. A program storage device, readable by one or more programmable control devices, comprising instructions stored thereon for causing the one or more programmable control devices to perform the method of claim 1.

23. A computer system comprising:

one or more displays;

memory; and

one or more processors operatively couple to the one or more displays and the memory, the memory having stored therein instructions executable by the one or more processors for performing the method of claim 14.

24. A program storage device, readable by one or more programmable control devices, comprising instructions stored thereon for causing the one or more programmable control devices to perform the method of claim 14.

16. A method of generating an output on a computer display, the method comprising:

a) obtaining a first image, the first image having a first color space;

b) identifying a first filter to change the first color space of the first image to a second color space;

c) identifying one or more second filters to perform a function on a second image;

d) identifying a third filter to change the color space of a third image to a third color space;

e) applying the first filter to the first image to generate the second image;

f) applying the one or more second filters to the second image to generate the third image;

g) applying the third filter to the third image to generate a result image;

h) rendering the result image to a memory; and

i) displaying the result image on a display.

17. The method of claim 16, wherein the first and third color spaces are the same color space.

18. The method of claim 16, wherein the act of applying the one or more second filters is performed by a graphics processing unit.

19. The method of claim 16, wherein at least one of the first filter, one or more second filters and third filters comprise at least one filter pre-defined in an application programming interface (API).

20. The method of claim 16 wherein the act of identifying one or more of the first filter, one or more second filters and third filter comprises creating the one or more filters.

21. The method of claim 16, wherein the acts (a) through (h) are performed using one or more application programming interfaces (APIs), and wherein at least one of the APIs comprises an OpenGL library.

22. The method of claim 16, wherein the act of rendering the result image to a memory comprises rendering the result image into a context.

25. The method of claim 16, wherein the acts (a) through (h) are performed using one or more application programming interfaces (APIs), and wherein at least one of the APIs makes use of OpenGL functions.

26. The method of claim 16, wherein the acts of applying one or more of the first filter, the one or more second filters, and the third filter comprise optimizing the one or more filters before the act of applying.