Time-based degradation of images using a GPU

• US 8,547,378 B2
• Filed: 08/28/2008
• Issued: 10/01/2013
• Est. Priority Date: 08/28/2008
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: O'Donnell, Daniel, Carscadden, John G.
• Primary Examiner(s): McDowell, Jr., Maurice L
• Application Number:
  US12/200,323
• Publication Number:
  US 20130120388A1
• Time in Patent Office: 1,860 Days
• Field of Search: 345/428, 345/545, 345/698
• US Class Current: 345/428
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 2200/16 involving adaptation to the client's capabilities

Abstract

A method, system, and computer-readable storage medium are disclosed for time-based degradation of images. In one embodiment, the rendering of a first frame of a digital video using a GPU may be initiated. In one embodiment, it may be determined that a time elapsed in rendering the first frame exceeds a threshold. In one embodiment, a downsampling factor may be determined in response to determining that the time elapsed exceeds the threshold. In one embodiment, a second frame of the digital video comprising a second set of one or more images may be rendered based on the downsampling factor using the GPU. Rendering the second frame based on the downsampling factor may comprise sending each of the second set of images to the GPU at a reduced resolution comprising a respective original resolution for each image divided by the downsampling factor.

Claims

1. A computer-implemented method, comprising:

initiating a rendering of a first frame of a digital video using a graphics processing unit (GPU), wherein the first frame comprises a first set of one or more images;

measuring a time elapsed in rendering the first frame;

automatically determining that the time elapsed in rendering the first frame exceeds a pre-determined threshold, wherein the pre-determined threshold comprises a duration of time;

determining a downsampling factor in response to determining that the time elapsed in rendering the first frame exceeds the pre-determined threshold; and

rendering a second frame of the digital video based on the downsampling factor using the GPU, wherein the second frame comprises a second set of one or more images, wherein each of the second set of one or more images has a respective original resolution, wherein rendering the second frame of the digital video based on the downsampling factor using the GPU comprises sending each of the second set of one or more images to the GPU at a reduced resolution comprising the respective original resolution divided by the downsampling factor.

2. The method as recited in claim 1, further comprising:

rendering the first frame of the digital video based on the downsampling factor using the GPU, wherein each of the first set of one or more images has a respective original resolution, wherein rendering the first frame of the digital video based on the downsampling factor using the GPU comprises sending each of the first set of one or more images to the GPU at a reduced resolution comprising the respective original resolution divided by the downsampling factor.

3. The method as recited in claim 1, further comprising:

interrupting the rendering of the first frame of the digital video using the GPU in response to determining that the time elapsed in rendering the first frame exceeds the pre-determined threshold.

4. The method as recited in claim 1, wherein the rendering of the first frame of the digital video is initiated based on an initial downsampling factor, and wherein determining the downsampling factor comprises increasing the initial downsampling factor.

5. The method as recited in claim 1, further comprising:

initiating a rendering of a third frame of the digital video using the GPU, wherein the third frame comprises a third set of one or more images, wherein each of the third set of one or more images has a respective original resolution;

determining that a time elapsed in rendering the third frame exceeds the pre-determined threshold;

determining a second downsampling factor in response to determining that the time elapsed in rendering the third frame exceeds the pre-determined threshold, wherein the second downsampling factor is larger than the downsampling factor; and

rendering the third frame of the digital video based on the second downsampling factor using the GPU, comprising sending each of the third set of one or more images to the GPU at a further reduced resolution comprising the respective original resolution divided by the second downsampling factor.

6. The method as recited in claim 1, further comprising:

storing each of the second set of one or more images at the reduced resolution in a memory of the GPU;

receiving an instruction to redisplay the second frame of the digital video; and

retrieving the second set of one or more images from the memory of the GPU in response to receiving the instruction to redisplay the second frame of the digital video.

7. The method as recited in claim 1, further comprising:

receiving mouse input from a user; and

interrupting the rendering of the first frame of the digital video in response to receiving the mouse input from the user.

8. The method as recited in claim 1, wherein a first image of the second set of one or more images is nested within a second image of the second set of one or more images, wherein the first image comprises a first original resolution, wherein the second image comprises a second original resolution, and wherein rendering the second frame of the digital video based on the downsampling factor using the GPU comprises sending the first image to the GPU at a reduced resolution comprising the first original resolution divided by the downsampling factor and sending the second image to the GPU at a reduced resolution comprising the second original resolution divided by the downsampling factor.

9. The method as recited in claim 8, wherein the first image is stored in a memory of the GPU as a first framebuffer object, and wherein the second image is stored in the memory of the GPU as a second framebuffer object.

10. A computer-implemented method, comprising:

rendering a first set of one or more images using a graphics processing unit (GPU), wherein the first set of one or more images are reduced in resolution by a first downsampling factor;

measuring a time elapsed in rendering the first set of one or more images;

automatically determining that the time elapsed in rendering the first set of one or more images exceeds a pre-determined threshold, wherein the pre-determined threshold comprises a duration of time; and

rendering a second set of one or more images using the GPU subsequent to rendering the first set of one or more images, wherein the second set of one or more images are reduced in resolution by a second downsampling factor, wherein the second downsampling factor is greater than the first downsampling factor.

11. A computer-readable storage device, storing program instructions, wherein the program instructions are computer-executable to implement:

initiating a rendering of a first frame of a digital video using a graphics processing unit (GPU), wherein the first frame comprises a first set of one or more images;

measuring a time elapsed in rendering the first frame;

automatically determining that the time elapsed in rendering the first frame exceeds a pre-determined threshold, wherein the pre-determined threshold comprises a duration of time;

determining a downsampling factor in response to determining that the time elapsed in rendering the first frame exceeds the pre-determined threshold; and

rendering a second frame of the digital video based on the downsampling factor using the GPU, wherein the second frame comprises a second set of one or more images, wherein each of the second set of one or more images has a respective original resolution, wherein rendering the second frame of the digital video based on the downsampling factor using the GPU comprises sending each of the second set of one or more images to the GPU at a reduced resolution comprising the respective original resolution divided by the downsampling factor.

12. The computer-readable storage device as recited in claim 11, wherein the program instructions are further computer-executable to implement:

rendering the first frame of the digital video based on the downsampling factor using the GPU, wherein each of the first set of one or more images has a respective original resolution, wherein rendering the first frame of the digital video based on the downsampling factor using the GPU comprises sending each of the first set of one or more images to the GPU at a reduced resolution comprising the respective original resolution divided by the downsampling factor.

13. The computer-readable storage device as recited in claim 11, wherein the program instructions are further computer-executable to implement:

interrupting the rendering of the first frame of the digital video using the GPU in response to determining that the time elapsed in rendering the first frame exceeds the pre-determined threshold.

14. The computer-readable storage device as recited in claim 11, wherein the rendering of the first frame of the digital video is initiated based on an initial downsampling factor, and wherein determining the downsampling factor comprises increasing the initial downsampling factor.

15. The computer-readable storage device as recited in claim 11, wherein the program instructions are further computer-executable to implement:

initiating a rendering of a third frame of the digital video using the GPU, wherein the third frame comprises a third set of one or more images, wherein each of the third set of one or more images has a respective original resolution;

determining that a time elapsed in rendering the third frame exceeds the pre-determined threshold;

determining a second downsampling factor in response to determining that the time elapsed in rendering the third frame exceeds the pre-determined threshold, wherein the second downsampling factor is larger than the downsampling factor; and

rendering the third frame of the digital video based on the second downsampling factor using the GPU, comprising sending each of the third set of one or more images to the GPU at a further reduced resolution comprising the respective original resolution divided by the second downsampling factor.

16. The computer-readable storage device as recited in claim 11, wherein the program instructions are further computer-executable to implement:

storing each of the second set of one or more images at the reduced resolution in a memory of the GPU;

receiving an instruction to redisplay the second frame of the digital video; and

retrieving the second set of one or more images from the memory of the GPU in response to receiving the instruction to redisplay the second frame of the digital video.

17. The computer-readable storage device as recited in claim 11, wherein the program instructions are further computer-executable to implement:

receiving mouse input from a user; and

interrupting the rendering of the first frame of the digital video in response to receiving the mouse input from the user.

18. The computer-readable storage device as recited in claim 11, wherein a first image of the second set of one or more images is nested within a second image of the second set of one or more images, wherein the first image comprises a first original resolution, wherein the second image comprises a second original resolution, and wherein rendering the second frame of the digital video based on the downsampling factor using the GPU comprises sending the first image to the GPU at a reduced resolution comprising the first original resolution divided by the downsampling factor and sending the second image to the GPU at a reduced resolution comprising the second original resolution divided by the downsampling factor.

19. The computer-readable storage device as recited in claim 18, wherein the first image is stored in a memory of the GPU as a first framebuffer object, and wherein the second image is stored in the memory of the GPU as a second framebuffer object.

20. A computer-readable storage device, storing program instructions, wherein the program instructions are computer-executable to implement:

rendering a first set of one or more images using a graphics processing unit (GPU), wherein the first set of one or more images are reduced in resolution by a first downsampling factor;

measuring a time elapsed in rendering the first set of one or more images;

automatically determining that the time elapsed in rendering the first set of one or more images exceeds a pre-determined threshold, wherein the pre-determined threshold comprises a duration of time; and

rendering a second set of one or more images using the GPU subsequent to rendering the first set of one or more images, wherein the second set of one or more images are reduced in resolution by a second downsampling factor, wherein the second downsampling factor is greater than the first downsampling factor.

21. A system, comprising:

at least one processor;

a graphics processing unit (GPU) coupled to the at least one processor; and

a memory coupled to the at least one processor, wherein the memory stores program instructions, wherein the program instructions are executable by the at least one processor to;

initiate a rendering of a first frame of a digital video, wherein the first frame comprises a first set of one or more images;

measure a time elapsed in rendering the first frame;

automatically determine that the time elapsed in rendering the first frame exceeds a pre-determined threshold, wherein the pre-determined threshold comprises a duration of time;

determine a downsampling factor in response to determining that the time elapsed in rendering the first frame exceeds the pre-determined threshold; and

render a second frame of the digital video based on the downsampling factor, wherein the second frame comprises a second set of one or more images, wherein each of the second set of one or more images has a respective original resolution, wherein rendering the second frame of the digital video based on the downsampling factor comprises sending each of the second set of one or more images to the GPU at a reduced resolution comprising the respective original resolution divided by the downsampling factor.

22. The system as recited in claim 21, wherein the program instructions are further executable by the at least one processor to:

render the first frame of the digital video based on the downsampling factor, wherein each of the first set of one or more images has a respective original resolution, wherein rendering the first frame of the digital video based on the downsampling factor comprises sending each of the first set of one or more images to the GPU at a reduced resolution comprising the respective original resolution divided by the downsampling factor.

23. The system as recited in claim 21, wherein the program instructions are further executable by the at least one processor to:

interrupt the rendering of the first frame of the digital video in response to determining that the time elapsed in rendering the first frame exceeds the pre-determined threshold.

24. The system as recited in claim 21, wherein the rendering of the first frame of the digital video is initiated based on an initial downsampling factor, and wherein determining the downsampling factor comprises increasing the initial downsampling factor.

25. The system as recited in claim 21, wherein the program instructions are further executable by the at least one processor to:

initiate a rendering of a third frame of the digital video, wherein the third frame comprises a third set of one or more images, wherein each of the third set of one or more images has a respective original resolution;

determine that a time elapsed in rendering the third frame exceeds the pre-determined threshold;

determine a second downsampling factor in response to determining that the time elapsed in rendering the third frame exceeds the pre-determined threshold, wherein the second downsampling factor is larger than the downsampling factor; and

render the third frame of the digital video based on the second downsampling factor, comprising sending each of the third set of one or more images to the GPU at a further reduced resolution comprising the respective original resolution divided by the second downsampling factor.

26. The system as recited in claim 21, wherein the program instructions are further executable by the at least one processor to:

store each of the second set of one or more images at the reduced resolution in a memory of the GPU;

receive an instruction to redisplay the second frame of the digital video; and

retrieve the second set of one or more images from the memory of the GPU in response to receiving the instruction to redisplay the second frame of the digital video.

27. The system as recited in claim 21, wherein the program instructions are further executable by the at least one processor to:

receive mouse input from a user; and

interrupt the rendering of the first frame of the digital video in response to receiving the mouse input from the user.

28. The system as recited in claim 21, wherein a first image of the second set of one or more images is nested within a second image of the second set of one or more images, wherein the first image comprises a first original resolution, wherein the second image comprises a second original resolution, and wherein rendering the second frame of the digital video based on the downsampling factor comprises sending the first image to the GPU at a reduced resolution comprising the first original resolution divided by the downsampling factor and sending the second image to the GPU at a reduced resolution comprising the second original resolution divided by the downsampling factor.

29. The system as recited in claim 28, wherein the first image is stored in a memory of the GPU as a first framebuffer object, and wherein the second image is stored in the memory of the GPU as a second framebuffer object.

30. A system, comprising:

at least one processor;

a graphics processing unit (GPU) coupled to the at least one processor and comprising a graphics memory; and

a memory coupled to the at least one processor, wherein the memory stores program instructions, wherein the program instructions are executable by the at least one processor to;

render a first set of one or more images, wherein the first set of one or more images are reduced in resolution by a first downsampling factor and stored in the graphics memory;

measure a time elapsed in rendering the first set of one or more images;

automatically determine that the time elapsed in rendering the first set of one or more images exceeds a pre-determined threshold, wherein the pre-determined threshold comprises a duration of time;

render a second set of one or more images subsequent to rendering the first set of one or more images, wherein the second set of one or more images are reduced in resolution by a second downsampling factor and stored in the graphics memory, wherein the second downsampling factor is greater than the first downsampling factor.