METHOD AND APPARATUS FOR GENERATING THREE-DIMENSIONAL PANORAMIC VIDEO
First Claim
1. A method for generating a three-dimensional panoramic video, for use in an electronic apparatus having a processor, and comprising:
- capturing a plurality of frames from a panoramic video;
transforming each of the frames into a polyhedral mapping projection, wherein the polyhedral mapping projection comprises a plurality of side planes, a top plane and a bottom plane;
calculating displacements of a plurality of pixels in the side planes by using the side planes of the transformed polyhedral mapping projection of each of the frames, and calculating displacements of a plurality of pixels in the top plane and the bottom plane of the polyhedral mapping projection by using the displacements of the pixels of the side planes;
shifting the pixels in the side planes, the top plane and the bottom plane of the transformed polyhedral mapping projection of each of the frames according the calculated displacements of the polyhedral mapping projection to generate a shifted polyhedral mapping projection; and
transforming, for each of the frames, the shifted polyhedral mapping projection into a shifted frame with a two-dimensional space format, and combining the shifted frame and its corresponding frame into a three-dimensional image, and encoding the three-dimensional images of the frames into a three-dimensional panoramic video.
1 Assignment
0 Petitions
Accused Products
Abstract
A method and an apparatus for generating 3D panoramic video are provided. In the method, plural frames are captured from a panoramic video. Each frame is transformed into a polyhedral mapping projection comprising side planes, a top plane and a bottom plane. Displacements of pixels in the side planes are calculated by using the side planes of each frame, and displacements of pixels in the top plane and the bottom plane are calculated by using the displacements of the side planes. Then, the pixels in the side planes, the top plane and the bottom plane of each frame are shifted according the displacements of the polyhedral mapping projection to generate a shifted polyhedral mapping projection. The shifted polyhedral mapping projection is transformed into a shifted frame with 2D space format. The shifted frames and corresponding frames construct 3D images and the 3D images are encoded into a 3D panoramic video.
-
Citations
20 Claims
-
1. A method for generating a three-dimensional panoramic video, for use in an electronic apparatus having a processor, and comprising:
-
capturing a plurality of frames from a panoramic video; transforming each of the frames into a polyhedral mapping projection, wherein the polyhedral mapping projection comprises a plurality of side planes, a top plane and a bottom plane; calculating displacements of a plurality of pixels in the side planes by using the side planes of the transformed polyhedral mapping projection of each of the frames, and calculating displacements of a plurality of pixels in the top plane and the bottom plane of the polyhedral mapping projection by using the displacements of the pixels of the side planes; shifting the pixels in the side planes, the top plane and the bottom plane of the transformed polyhedral mapping projection of each of the frames according the calculated displacements of the polyhedral mapping projection to generate a shifted polyhedral mapping projection; and transforming, for each of the frames, the shifted polyhedral mapping projection into a shifted frame with a two-dimensional space format, and combining the shifted frame and its corresponding frame into a three-dimensional image, and encoding the three-dimensional images of the frames into a three-dimensional panoramic video. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A three-dimensional panoramic video generating apparatus, comprising:
-
a connection device, connected to an image source device, and receiving a panoramic video from the image source device; a storage device, storing a plurality of modules; and a processor, coupled to the connection device and the storage device, and loading and executing the modules in the storage device, wherein the modules comprise; a frame capturing module, capturing a plurality of frames from the panoramic video; a mapping module, transforming each of the frames into a polyhedral mapping projection, wherein the polyhedral mapping projection comprises a plurality of side planes, a top plane and a bottom plane; a parallax calculating module, calculating displacements of a plurality of pixels in the side planes by using the side planes of the transformed polyhedral mapping projection of each of the frames, and calculating displacements of a plurality of pixels in the top plane and the bottom plane of the polyhedral mapping projection by using the displacements of the pixels of the side planes; a pixel shifting module, shifting the pixels in the side planes, the top plane and the bottom plane of the transformed polyhedral mapping projection of each of the frames according the calculated displacements of the polyhedral mapping projection to generate a shifted polyhedral mapping projection; a transforming module, transforming the shifted polyhedral mapping projection of each of the frames into a shifted frame with a two-dimensional space format; and a video encoding module, combining the shifted frame and its corresponding frame into a three-dimensional image and encoding the three-dimensional images of the frames into a three-dimensional panoramic video. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification