Encoding 3D rendered images by tagging objects

• US 10,547,846 B2
• Filed: 04/17/2017
• Issued: 01/28/2020
• Est. Priority Date: 04/17/2017
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Johnston, Robert J., Appu, Abhishek R., Baran, Stanley J., Lee, Sang-Hee, Mohammed, Atthar H., Oh, Jong Dae, Chan, Hiu-Fai R., Ray, Joydeep
• Primary Examiner(s): Zhou, Zhihan
• Application Number:
  US15/488,801
• Publication Number:
  US 20180300905A1
• Time in Patent Office: 1,016 Days
• CPC Class Codes: G11B 27/00 Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
• CPC Class Codes: G11B 27/30 on the same track as the main recording
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/137 Motion inside a coding unit, e.g. average field, frame or block difference
• CPC Class Codes: H04N 19/167 Position within a video image, e.g. region of interest [ROI]
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/182 the unit being a pixel

Abstract

Image information is often transmitted from one electronic device to another. Such information is typically encoded and/or compressed to reduce the bandwidth required for transmission and/or to decrease the time necessary for transmission. Embodiments are directed to tagging objects or primitives with attribute tags to facilitate the encoding process. Other embodiments are directed to codecs running on hardware and/or software.

Claims

1. A method, comprising:

generating a video stream;

tagging primitives in the video stream as background or foreground;

processing the video stream through a 3D pipeline;

tagging individual pixels with an attribute tag indicating background or foreground by storing the attribute tag indicating background or foreground on a metadata surface mapping to each of the individual pixels;

storing the pixels in a frame memory and storing corresponding attribute tags in a corresponding tag memory; and

encoding the pixels in the frame memory using the attribute tags to select a type of encoding,

wherein a rasterizer in the 3D pipeline tags individual pixels with an attribute tag indicating background or foreground,

wherein the rasterizer is to tag individual pixels with an attribute tag indicating moving or static by storing the attribute tag indicating moving or static on a metadata surface mapping to each of the individual pixels.

2. The method as recited in claim 1, wherein generating a video stream is accomplished with a 3D engine.

3. The method of claim 1 wherein foreground pixels are encoded at a higher quality.

4. An apparatus, comprising:

a 3D engine to generate a video stream and tag primitives in the video stream as background or foreground;

a 3D pipeline to process the video stream;

a rasterizer associated with the 3D pipeline to tag individual pixels with an attribute tag indicating background or foreground by storing the attribute tag indicating background or foreground on a metadata surface mapping to each of the individual pixels;

a frame buffer memory to store the pixels in a frame and a corresponding attribute memory to store the attribute tags; and

an encoder to use the attribute tags to select a type of encoding,

wherein the rasterizer is to tag the individual pixels with an attribute tag indicating moving or static by storing the attribute tag indicating moving or static on a metadata surface mapping to each of the individual pixels.

5. The apparatus as recited in claim 4 further comprising:

a pixel shader to output the pixels and attribute tags to memory.

6. The apparatus as recited in claim 4 wherein foreground pixels are encoded at a higher quality.

7. At least one non-transitory computer readable medium having instructions stored thereon that when executed by a processor causes the processor to:

generating a video stream;

tagging primitives in the video stream as background or foreground;

processing the video stream through a 3D pipeline;

tagging individual pixels with an attribute tag indicating background or foreground;

storing the pixels in a frame memory and storing corresponding attribute tags in a corresponding tag memory; and

encoding the pixels in the frame memory using the attribute tags to select a type of encoding,

wherein a rasterizer in the 3D pipeline tags individual pixels with an attribute tag indicating background or foreground by storing the attribute tag indicating background or foreground on a metadata surface mapping to each of the individual pixels, and

wherein the rasterizer is to tag individual pixels with an attribute tag indicating moving or static.

8. The non-transitory computer readable medium as recited in claim 7, wherein generating a video stream is accomplished with a 3D engine.

9. The non-transitory computer readable medium as recited in claim 7 wherein a rasterizer in the 3D pipeline tags individual pixels with an attribute tag indicating background or foreground.

10. The non-transitory computer readable medium as recited in claim 7 wherein foreground pixels are encoded at a higher quality.

11. The non-transitory computer readable medium as recited in claim 7 wherein background pixels are encoded at a lower quality.