CONCEALED REGIONS COMPLEMENTING SYSTEM OF FREE VIEWPOINT VIDEO IMAGES
First Claim
1. A concealed regions complementing system of free viewpoint video images in which when the free viewpoint video images are output, the pixels in background regions concealed by foreground regions in a reference video image are complemented, said system comprising background regions extracting means for extracting, from an input video image, the background regions as a single-layered background video image and multi-layered background video images divided in accordance with depth,a single-layered background buffer for storing the single-layered background video image, andmulti-layered background buffers for storing the multi-layered background video images, whereinwhen the free viewpoint video images are output, the pixels in the background regions concealed by foreground regions in a reference video image are complemented using the pixels of the multi-layered background video images stored in the multi-layered background buffers, and the pixels which are not complemented by this operation are complemented using the pixels of the single-layered background video image stored in the single-layered background buffer.
0 Assignments
0 Petitions
Accused Products
Abstract
A sender produces a background video image 4 from a reference video image 1 and a depth map 3 and synthesizes the background video image 4 in a background buffer 5. A projection converting matrix 6 for synthesizing is calculated. A receiver receives the reference video image 1, the depth map 3 and the projection converting matrix 6. The receiver produces a free viewpoint video image 11 and a background video image 12. The background buffer 13 is dynamically renewed. The free viewpoint video image 11 and the image in the background buffer 13 are synthesized with each other, and the background video image in the concealed regions in the free viewpoint video image are complemented to obtain the complemented image 14.
-
Citations
4 Claims
-
1. A concealed regions complementing system of free viewpoint video images in which when the free viewpoint video images are output, the pixels in background regions concealed by foreground regions in a reference video image are complemented, said system comprising background regions extracting means for extracting, from an input video image, the background regions as a single-layered background video image and multi-layered background video images divided in accordance with depth,
a single-layered background buffer for storing the single-layered background video image, and multi-layered background buffers for storing the multi-layered background video images, wherein when the free viewpoint video images are output, the pixels in the background regions concealed by foreground regions in a reference video image are complemented using the pixels of the multi-layered background video images stored in the multi-layered background buffers, and the pixels which are not complemented by this operation are complemented using the pixels of the single-layered background video image stored in the single-layered background buffer.
Specification