Displaying immersive videos using tiled decompression

• US 6,515,673 B1
• Filed: 02/16/2000
• Issued: 02/04/2003
• Est. Priority Date: 02/16/2000
• Status: Expired due to Fees

• Current Assignee: DigiMedia Tech, LLC (IP Investments Group LLC)
• Original Assignee: Enroute Incorporated
• Inventors: Lavin, Andrew J., Hashimoto, Roy T.
• Primary Examiner(s): Razavi, Micahel
• Assistant Examiner(s): HAVAN, THU THAO
• Application Number:
  US09/505,339
• Time in Patent Office: 1,084 Days
• Field of Search: 345/581-588, 345/427-428, 345/419-423, 345/441-442, 345/619, 345/625-628, 345/646-649, 345/555-572, 345/622, 345/426, 345/443, 345/848, 382/176, 382/294, 382/199, 382/291, 382/154, 348/620, 348/207, 348/143, 348/39, 348/37
• US Class Current: 345/582
• CPC Class Codes: G06T 15/04 Texture mapping
• CPC Class Codes: H04N 19/44 Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder

Abstract

An immersive video display system is configured to display an immersive video formed by a plurality of compressed environment maps. The immersive video display system includes a decompression unit to partially decompress each compressed environment map to create a partially decompressed environment map. A texture rendering unit creates an image for a view window for each of the compressed environment maps by texture mapping the visible portion of a texture projection using the partially decompressed environment map. By decompressing only a portion of the compressed environment map, the immersive video display system requires less processing time to generate the contents of the view window.

Claims

1. A method for displaying an immersive video formed from a plurality of compressed environment map, wherein each compressed environment map includes a header and a plurality of compressed tiles and wherein each compressed tile corresponds with an uncompressed tile of an environment map, the method comprising:

selecting a plurality of relevant uncompressed tiles for each of the compressed environment maps by;

selecting each uncompressed tile that encompasses a view frustum encompassing the view window;

selecting each uncompressed tile contained within the view frustum; and

selecting each uncompressed tile having at least one side crossing a side of the view frustum;

retrieving a compressed tile corresponding to each relevant uncompressed tile from each compressed environment map thereby forming a plurality of relevant compressed tiles for each compressed environment map;

decompressing each of the relevant compressed tiles of each compressed environment map to form a partially decompressed environment map for each compressed environment map; and

creating an image for a view window for each compressed environment map by texture mapping a visible portion of a texture projection using each partially decompressed environment map.

2. A method for displaying an immersive video formed from a plurality of compressed environment map, wherein each compressed environment map includes a header and a plurality of compressed tiles and wherein each compressed tile corresponds with an uncompressed tile of an environment map, the method comprising:

selecting a plurality of relevant uncompressed tiles for each of the compressed environment maps, wherein each uncompressed tile has a plurality of vertices;

retrieving a compressed tile corresponding to each relevant uncompressed tile from each compressed environment map thereby forming a plurality of relevant compressed tiles for each compressed environment map;

decompressing each of the relevant compressed tiles of each compressed environment map to form a partially decompressed environment map for each compressed environment map;

creating an image for a view window for each compressed environment map by texture mapping a visible portion of a texture projection using each partially decompressed environment map; and

classifying each vertex of each uncompressed tile by

determining whether each vertex is above a view frustum;

determining whether each vertex is below the view frustum;

determining whether each vertex is the right of the view frustum; and

determining whether each vertex is to the left of the view frustum.

3. The method of claim 2 further comprising:

setting a first bit of a bit code of a vertex when the vertex is to the left of the view frustum;

setting a second bit of the bit code of the vertex when the vertex is to the right of the view frustum;

setting a third bit of the bit code of the vertex when the vertex is below the view frustum; and

setting a fourth bit of the bit code of a vertex when the vertex is above the view frustum.

4. The method of claim 3, wherein selecting a plurality of relevant uncompressed tiles for each compressed environment map comprises:

selecting each uncompressed tile as a relevant uncompressed tile when a bitwise logic AND of a bit-code of a first vertex of a tile with a bit-code of a second vertex of the tile is equal to zero, wherein said first vertex and said second vertex are adjacent vertices; and

selecting each uncompressed tile as a relevant uncompressed tile when a bitwise XOR of the bit-code the first vertex with a bit-code of a first opposite vertex is equal to 1111b and a bitwise XOR of the bit-code of the second vertex with a bit-code of a second opposite vertex is equal to 1111b.

5. An immersive video display system for displaying an immersive video formed from a plurality of compressed environment map, wherein each compressed environment map includes a header and a plurality of compressed tiles and wherein each compressed tile corresponds with an uncompressed tile of an environment map and wherein each uncompressed tile has a plurality of vertices, the immersive video display system comprising:

a decompression unit configured to create a partially decompressed environment map for each compressed environment map;

a texture rendering unit coupled to the decompression unit and configured to generate an image for a view window for each compressed environment map by texture mapping a visible portion of a texture projection using the corresponding partially decompressed environment map;

a tile selector configured to receive each of the compressed environment map and to select a plurality of relevant uncompressed tiles for each compressed environment map;

a tile decompressor coupled to the tile selector and configured to decompress each compressed tile corresponding to one of the relevant uncompressed tiles to form a plurality of decompressed tiles; and

a decompressed image collation unit coupled to the tile decompressor and configured to create the partially decompressed environment map using the plurality of decompressed tiles.

6. The immersive video display system of claim 5, wherein said tile selector uses the view window to select the plurality of relevant uncompressed tiles.

7. The immersive video display system of claim 6, wherein the tile selector is configured to select an uncompressed tile as relevant when the tile is visible in a view frustum of the view window.

8. The immersive video display system of claim 6, further comprising a tile vertex classifier coupled to the tile selector and configured to classify the vertices of each uncompressed tile.

9. The decompression unit of claim 6, wherein the tile vertex classifier is configured to determine if a vertex is above, below, to the left of, to the right of, or within a view frustum of the view window.