Video method for generating free viewpoint video image using divided local regions
First Claim
1. A free viewpoint video image generating method which generates a video image of an arbitrary viewpoint using video images of a object photographed by a plurality of cameras, each having a horizontal optical axis disposed to surround the object, comprising:
- a first step of dividing a real zone to local regions;
a second step of transforming a camera coordinate system of the camera using an internal parameter of the camera within each of the local regions so that the optical axis of the camera is directed to the local region;
a third step of enlarging or contracting the video image within the local region using information of distance between each of the cameras and the object, so that scales of the local regions on the video image are arranged to be identical;
a fourth step of generating a free viewpoint video image only within the local region using a method of image based rendering within each of the local regions;
a fifth step of enlarging or contracting the free viewpoint video image within each of the local regions so that the local region on the video image is of a prescribed scale;
a sixth step in which the coordinate system of each camera is transformed using an internal parameter of the camera so that the optical axis of the camera is directed to a prescribed optical axis, so as to obtain the free viewpoint video image of the local region; and
a seventh step of integrating the free viewpoint video image of each of the local region, whereinto generate a free viewpoint video image, viewed from a virtual viewpoint not located on a plane where the camera is disposed, moving a position of the virtual viewpoint video image of for each of the local regions within the free viewpoint video image for synthesis at the position of the virtual viewpoint is carried out in the seventh step or moving a position Q of information of ray to be read corresponding to the position of the virtual viewpoint is carried out in the fourth step.
1 Assignment
0 Petitions
Accused Products
Abstract
The present invention provides a method of generating a virtual viewpoint video image when the virtual viewpoint position is not located on a plane where a camera is disposed. In an environment in which a plurality of cameras having a horizontal optical axis are disposed in a real zone (for example, on the circumference) which surrounds an object, a video image of an arbitrary viewpoint on the circumference is generated. Further, by synthesizing video images photographed by a camera, a free viewpoint video image is generated from a virtual viewpoint (viewpoint from a high or low position) where no camera is placed. According to a method of achieving this, a travel distance of a display position is calculated by the local region synthesizing portion and this travel distance is reflected to the free viewpoint video image of a local region.
-
Citations
3 Claims
-
1. A free viewpoint video image generating method which generates a video image of an arbitrary viewpoint using video images of a object photographed by a plurality of cameras, each having a horizontal optical axis disposed to surround the object, comprising:
-
a first step of dividing a real zone to local regions; a second step of transforming a camera coordinate system of the camera using an internal parameter of the camera within each of the local regions so that the optical axis of the camera is directed to the local region; a third step of enlarging or contracting the video image within the local region using information of distance between each of the cameras and the object, so that scales of the local regions on the video image are arranged to be identical; a fourth step of generating a free viewpoint video image only within the local region using a method of image based rendering within each of the local regions; a fifth step of enlarging or contracting the free viewpoint video image within each of the local regions so that the local region on the video image is of a prescribed scale; a sixth step in which the coordinate system of each camera is transformed using an internal parameter of the camera so that the optical axis of the camera is directed to a prescribed optical axis, so as to obtain the free viewpoint video image of the local region; and a seventh step of integrating the free viewpoint video image of each of the local region, wherein to generate a free viewpoint video image, viewed from a virtual viewpoint not located on a plane where the camera is disposed, moving a position of the virtual viewpoint video image of for each of the local regions within the free viewpoint video image for synthesis at the position of the virtual viewpoint is carried out in the seventh step or moving a position Q of information of ray to be read corresponding to the position of the virtual viewpoint is carried out in the fourth step. - View Dependent Claims (2, 3)
-
Specification