METHODS AND APPARATUS FOR SUPPORTING CONTENT GENERATION, TRANSMISSION AND/OR PLAYBACK
First Claim
1. A method of operating an image processing system, the method comprising:
- receiving a first image corresponding to a portion of an environment, said first image including a non-occluded image portion corresponding to a portion of the environment visible from a first location;
receiving an additional image of the environment including at least a first occluded image portion corresponding to a portion of the environment occluded from view from said first location;
generating a first frame including image content from said non-occluded image portion of said first image and image content from said first occluded image portion of the additional image; and
storing said first frame in a storage device or transmitting said first frame to another device.
5 Assignments
0 Petitions
Accused Products
Abstract
Methods and apparatus for supporting the capture of images of surfaces of an environment visible from a default viewing position and capturing images of surfaces not visible from the default viewing position, e.g., occluded surfaces, are described. Occluded and non-occluded image portions are packed into one or more frames and communicated to a playback device for use as textures which can be applied to a model of the environment where the images were captured. An environmental model includes a model of surfaces which are occluded from view from a default viewing position but which maybe viewed is the user shifts the user'"'"'s viewing location. Occluded image content can be incorporated directly into a frame that also includes non-occluded image data or sent in frames of a separate, e.g., auxiliary content stream that is multiplexed with the main content stream which communicates image data corresponding to non-occluded environmental portions.
31 Citations
20 Claims
-
1. A method of operating an image processing system, the method comprising:
-
receiving a first image corresponding to a portion of an environment, said first image including a non-occluded image portion corresponding to a portion of the environment visible from a first location; receiving an additional image of the environment including at least a first occluded image portion corresponding to a portion of the environment occluded from view from said first location; generating a first frame including image content from said non-occluded image portion of said first image and image content from said first occluded image portion of the additional image; and storing said first frame in a storage device or transmitting said first frame to another device. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. The method of 1, wherein said first frame is in a second frame format, the method further comprising:
-
generating a frame in a first frame format, said frame in the first format including image content from said non-occluded image portion of said first frame and no image content corresponding to an occluded portion of the environment; and storing said frame in the first format in the storage device. - View Dependent Claims (9, 10, 11)
-
-
12. A non-transitory computer readable medium for use in a system, said non-transitory computer readable medium including computer executable instructions which, when executed by a computer, control the system to:
-
receive a first image corresponding to a portion of an environment, said first image including a non-occluded image portion corresponding to a portion of the environment visible from a first location; receive an additional image of the environment including at least a first occluded image portion corresponding to a portion of the environment occluded from view from said first location; generate a first frame including image content from said non-occluded image portion of said first image and image content from said first occluded image portion of the additional image; and store said first frame in a storage device or transmit said first frame to another device.
-
-
13. An image processing system, comprising:
-
a processor configured to control said image processing system to; receive a first image corresponding to a portion of an environment, said first image including a non-occluded image portion corresponding to a portion of the environment visible from a first location; receive an additional image of the environment including at least a first occluded image portion corresponding to a portion of the environment occluded from view from said first location; generate a first frame including image content from said non-occluded image portion of said first image and image content from said first occluded image portion of the additional image; and store said first frame in a storage device or transmit said first frame to another device. - View Dependent Claims (14, 15, 16)
-
-
17. The image processing system of 13, wherein said first frame is in a second frame format;
- and
wherein said processor is further configured to control said image processing system to; generate a frame in a first frame format, said frame in the first format including image content from said non-occluded image portion of said first frame and no image content corresponding to an occluded portion of the environment; and store said frame in the first format in the storage device. - View Dependent Claims (18, 19, 20)
- and
Specification