MOTION BASED ADAPTIVE RENDERING

• US 20180197304A1
• Filed: 03/06/2018
• Published: 07/12/2018
• Est. Priority Date: 06/27/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Golas, Abhinav, Ramani, Karthik, Cheng, Christopher T., Brothers, John W., Zhang, Liangjun, Abraham, Santosh, Chow, Ki Fung
• Granted Patent: US 10,643,339 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/40 Filling a planar surface by adding surface attributes, e.g. colour or texture
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 2200/12 involving antialiasing
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06T 7/30 Determination of transform parameters for the alignment of images, i.e. image registration
• CPC Class Codes: G06T 7/32 using correlation-based methods
• CPC Class Codes: G06T 7/337 involving reference images or patches
• CPC Class Codes: G09G 5/363 Graphics controllers

Abstract

An apparatus, system and method is provided to determine a motion of pixels in local regions of a scene, classify the motion into a speed category, and make decisions on how to render blocks of pixels. In one implementation the motion in a tile is classified into at least three different speed regimes. If the pixels in a tile are in a quasi-static speed regime, a determination is made whether or not to reuse a fraction of pixels from the previous frame. If the pixels are determined to be in a high speed regime, a decision is made whether or not a sampling rate may be reduced.

Claims

1. A method of stereoscopic rendering comprising:

receiving, by a stereoscopic display device, one or more first images;

displaying, by the stereoscopic display device, the first images to a first eye by rendering the first images; and

displaying, by the stereoscopic display device, one or more second images to the first eye or a second eye, wherein at least a portion of the second images is generated by using some or all of the first images by advection and any remaining portion of the second images is generated by rendering.

2. The method of claim 1, wherein generating the at least a portion of the second images by advection comprises advecting pixel values of the first images using a motion transform.

3. The method of claim 2, further comprising determining, by the stereoscopic display device, a minimum Z depth value corresponding to the first images, wherein the advecting pixel values of the first images is performed in response to the minimum Z depth value exceeding a threshold Z depth value.

4. The method of claim 1, wherein the first images comprise left eye images and the second images comprise right eye images.

5. The method of claim 1, wherein the rendering is based on a motion based sampling rate.

6. A stereoscopic display device comprising:

a first display that receives and displays a first image to a first eye of a user;

a GPU that generates a second image for display to a second eye of the user by reusing a portion of the first image and rendering a remaining portion of the second image; and

a second display that receives and displays the second image.

7. The stereoscopic display device of claim 6, wherein the first image comprises a plurality of tiles, each of the tiles comprising a plurality of pixels, and some of the pixels in at least one of the tiles are reused to generate the second image.

8. The stereoscopic display device of claim 7, wherein reusing the portion of the first image comprises identifying locations of one or more of the pixels in the first image and reusing the one or more of the pixels in the second image using a motion transform.

9. The stereoscopic display device of claim 6, wherein the GPU is configured to determine a minimum Z depth value corresponding to the first image, and to reuse the portion of the first image in response to the minimum Z depth value exceeding a threshold Z depth value.

10. The stereoscopic display device of claim 6, wherein the first image comprises a left eye image and the second image comprises a right eye image.

11. The stereoscopic display device of claim 6, wherein the GPU is configured to render the remaining portion of the second image based on a motion based sampling rate.

12. A graphics processing system comprising:

a first memory that receives a first image; and

a GPU that generates a second image by reusing a portion of the first image and rendering a remaining portion of the second image.

13. The graphics processing system of claim 12, wherein the first image comprises a plurality of tiles, each of the tiles comprising a plurality of pixels, and some of the pixels in at least one of the tiles are reused to generate the second image.

14. The graphics processing system of claim 13, wherein reusing the portion of the first image comprises identifying locations of one or more of the pixels in the first image and reusing the one or more of the pixels in the second image using a motion transform.

15. The graphics processing system of claim 12, wherein the GPU is configured to determine a minimum Z depth value corresponding to the first image, and to reuse the portion of the first image in response to the minimum Z depth value exceeding a threshold Z depth value.

16. The graphics processing system of claim 12, wherein the first image comprises a left eye image and the second image comprises a right eye image.

17. The graphics processing system of claim 12, wherein the GPU is configured to render the remaining portion of the second image based on a motion based sampling rate.