Mixed reality coding with overlays
First Claim
1. A system comprising:
- a camera to capture real world content;
a semiconductor package apparatus coupled to the camera, wherein the semiconductor package apparatus includes;
a substrate and logic coupled to the substrate, wherein the logic includes;
a graphics pipeline to generate rendered content,a base layer encoder to encode the real world content into a base layer and a first layer encoder to encode the rendered content into a first non-base layer, anda multiplexer to interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content; and
a transmitter to transmit the single output signal,wherein a second layer encoder is to encode map data into a second non-base layer, and the multiplexer is to interleave the second non-base layer with the first non-base layer and the base layer; and
wherein the first and second layer encoders encode the rendered content and the map data into overlay auxiliary pictures and the map data distinguishes between placement of objects within another overlay auxiliary picture on another layer.
1 Assignment
0 Petitions
Accused Products
Abstract
A system includes a camera to capture real world content and a semiconductor package apparatus. The semiconductor package apparatus includes a substrate and logic. The logic includes a graphics pipeline to generate rendered content, a base layer encoder to encode real world content into a base layer and a first layer encoder to encode rendered content into a first non-base layer, a multiplexer to interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content, and a transmitter to transmit the single output signal. The system further includes a second layer encoder to encode map data into a second non-base layer. The multiplexer to interleave the second non-base layer with the first non-base layer and the base layer. The first and second layer encoders encode the rendered content and the map data into overlay auxiliary pictures.
-
Citations
17 Claims
-
1. A system comprising:
-
a camera to capture real world content; a semiconductor package apparatus coupled to the camera, wherein the semiconductor package apparatus includes; a substrate and logic coupled to the substrate, wherein the logic includes; a graphics pipeline to generate rendered content, a base layer encoder to encode the real world content into a base layer and a first layer encoder to encode the rendered content into a first non-base layer, and a multiplexer to interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content; and a transmitter to transmit the single output signal, wherein a second layer encoder is to encode map data into a second non-base layer, and the multiplexer is to interleave the second non-base layer with the first non-base layer and the base layer; and wherein the first and second layer encoders encode the rendered content and the map data into overlay auxiliary pictures and the map data distinguishes between placement of objects within another overlay auxiliary picture on another layer. - View Dependent Claims (2, 3)
-
-
4. A system comprising:
-
a camera to capture real world content; a semiconductor package apparatus coupled to the camera, wherein the semiconductor package apparatus includes; a substrate and logic coupled to the substrate, wherein the logic includes; a graphics pipeline to generate rendered content, a base layer encoder to encode the real world content into a base layer and a first layer encoder to encode the rendered content into a first non-base layer, and a multiplexer to interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content; and a transmitter to transmit the single output signal, wherein a second layer encoder is to encode map data into a second non-base layer, and the multiplexer is to interleave the second non-base layer with the first non-base layer and the base layer; and wherein a third layer encoder is to encode blending data into a third non-base layer, and the multiplexer is to interleave the third non-base layer with the second non-base layer, the first non-base layer and the base layer. - View Dependent Claims (5)
-
-
6. An apparatus comprising:
-
a substrate; and logic coupled to the substrate, wherein the logic is implemented in one or more of configurable logic or fixed-functionality hardware logic, the logic including; a demultiplexer to receive a single complex signal having multiple interleaved signals and to separate a base layer signal, a first non-base layer signal, a second non-base layer signal, and a third non-base layer signal from the single complex signal; a base layer decoder to decode the base layer signal into real world content and a first layer decoder to decode the first non-base layer into a mixed reality content overlay; a second layer decoder to decode the second non-base layer into a map overlay and a third layer decoder to decode the third non-base layer into a blend overlay; and a compositor to allow a user to select or deselect one or more overlays and to composite the selected overlays with the decoded base layer for display. - View Dependent Claims (7, 8, 9)
-
-
10. A method comprising:
-
encoding real world content into a base layer; encoding rendered content into a first non-base layer; interleaving the base layer with the first non-base layer to obtain a single output signal having mixed reality content; and encoding map data into a second non-base layer, wherein the rendered content is encoded into an overlay auxiliary picture and the map data distinguishes between placement of objects within one or more overlay auxiliary pictures on another layer. - View Dependent Claims (11, 12)
-
-
13. A method comprising:
-
encoding real world content into a base layer; encoding rendered content into a first non-base layer; interleaving the base layer with the first non-base layer to obtain a single output signal having mixed reality content; encoding map data into a second non-base layer; interleaving the second non-base layer with the first non-base layer and the base layer; encoding blending data into a third non-base layer; and interleaving the third non-base layer with the second non-base layer, the first non-base layer and the base layer.
-
-
14. At least one non-transitory computer readable medium comprising a set of instructions, which when executed by a computing system, cause the computing system to:
-
encode real world content into a base layer; encode rendered content into a first non-base layer; interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content; and encode map data into a second non-base layer, wherein the rendered content is encoded into an overlay auxiliary picture and the map data distinguishes between placement of objects within one or more overlay auxiliary pictures on another layer. - View Dependent Claims (15, 16)
-
-
17. At least one non-transitory computer readable medium comprising a set of instructions, which when executed by a computing system, cause the computing system to:
-
encode real world content into a base layer; encode rendered content into a first non-base layer; interleave the base layer with the first non-base layer to obtain a single output signal having mixed reality content; encode map data into a second non-base layer; interleave the second non-base layer with the first non-base layer and the base layer; encode blending data into a third non-base layer; and interleave the third non-base layer with the second non-base layer, the first non-base layer and the base layer.
-
Specification