Joint View Expansion And Filtering For Automultiscopic 3D Displays
First Claim
1. A method of rendering a three-dimensional (3D) video display, comprising the computer-implemented steps, by a processor and associated memory:
- receiving a video stream formed of a sequence of frames, each frame having image content corresponding to a plurality of views, the views being initial views;
applying one or more spatial band pass filters to the received image content resulting in filtered images, each spatial band pass filter having a respective spatial frequency band;
from the filtered images, computing one or more output images that synthesize additional views with respect to the initial views, the output images computed from the filtered images of a given spatial band pass filter corresponding to different visual disparities for the respective spatial frequency band of that given band pass filter;
the computing of output images enabling optionally including removing inter-view (inter-perspective) aliasing by filtering the output images according to local depth using phase shift instead of recovering depth information; and
driving a display with the computed and optionally anti-aliased filtered output images, rendering a multi-view autostereoscopic 3D video display.
3 Assignments
0 Petitions
Accused Products
Abstract
Multi-view autostereoscopic displays provide an immersive, glasses-free 3D viewing experience, but they preferably use correctly filtered content from multiple viewpoints. The filtered content, however, may not be easily obtained with current stereoscopic production pipelines. The proposed method and system takes a stereoscopic video as an input and converts it to multi-view and filtered video streams that may be used to drive multi-view autostereoscopic displays. The method combines a phase-based video magnification and an interperspective antialiasing into a single filtering process. The whole algorithm is simple and may be efficiently implemented on current GPUs to yield real-time performance. Furthermore, the ability to retarget disparity is naturally supported. The method is robust and works transparent materials, and specularities. The method provides superior results when compared to the state-of-the-art depth-based rendering methods. The method is showcased in the context of a real-time 3D videoconferencing system.
38 Citations
26 Claims
-
1. A method of rendering a three-dimensional (3D) video display, comprising the computer-implemented steps, by a processor and associated memory:
-
receiving a video stream formed of a sequence of frames, each frame having image content corresponding to a plurality of views, the views being initial views; applying one or more spatial band pass filters to the received image content resulting in filtered images, each spatial band pass filter having a respective spatial frequency band; from the filtered images, computing one or more output images that synthesize additional views with respect to the initial views, the output images computed from the filtered images of a given spatial band pass filter corresponding to different visual disparities for the respective spatial frequency band of that given band pass filter; the computing of output images enabling optionally including removing inter-view (inter-perspective) aliasing by filtering the output images according to local depth using phase shift instead of recovering depth information; and driving a display with the computed and optionally anti-aliased filtered output images, rendering a multi-view autostereoscopic 3D video display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A computer-implemented system for rendering a three-dimensional (3D) video display, comprising:
-
a receiving module configured to receive a video stream formed of a sequence of frames, each frame having image content corresponding to a plurality of views, the views being initial views; a computing module responsive to the receiving module and configured to apply one or more spatial band pass filters to the received image content resulting in filtered images, each spatial band pass filter having a respective spatial frequency band; the computing module further configured to compute, from the filtered images, one or more output images that synthesize additional views with respect to the initial views, the output images computed from the filtered images of a given spatial band pass filter corresponding to different visual disparities for the respective spatial frequency band of that given band pass filter; the computing module further configured to enable optionally including removing inter-view (inter-perspective) aliasing by filtering the output images according to local depth using phase shift instead of recovering depth information; and a display module coupled to receive from the computing module and configured to drive a display with the computed and optionally anti-aliased filtered output images, rendering a multi-view autostereoscopic 3D video display. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25)
-
-
26. A non-transitory computer readable medium having stored thereon a sequence of instructions which, when loaded and executed by a processor coupled to an apparatus, causes the apparatus to:
-
receive a video stream formed of a sequence of frames, each frame having image content corresponding to a plurality of views, the views being initial views; apply one or more spatial band pass filters to the received image content resulting in filtered images, each spatial band pass filter having a respective spatial frequency band; compute, from the filtered images, one or more output images that synthesize additional views with respect to the initial views, the output images computed from the filtered images of a given spatial band pass filter corresponding to different visual disparities for the respective spatial frequency band of that given band pass filter; enable optionally including removing inter-view (inter-perspective) aliasing by filtering the output images according to local depth using phase shift instead of recovering depth information; and drive a display with the computed and optionally anti-aliased filtered output images, rendering a multi-view autostereoscopic 3D video display.
-
Specification