Systems and methods for creating an immersive video content environment
First Claim
1. A system comprising:
- a non-transitory memory storing an executable code;
a hardware processor executing the executable code to;
receive a video content including a plurality of frames showing a scene from a perspective of a real camera;
create a three-dimensional (3D) model of the scene using the plurality of frames;
store the 3D model of the scene in the non-transitory memory;
construct a synthetic view showing the scene from a first perspective of a virtual camera at a first location in the scene;
transmit the synthetic view of the scene for being displayed on a display located at a fixed position in a room;
track a position of a viewer in the room relative to the fixed position of the display in the room, using a camera or a wireless identification carried by the viewer, to determine a current position of the viewer in the room as the viewer is moving along a path from a first position in the room to a second position in the room at a distance from the first position;
dynamically adjust the synthetic view to show the scene from a second perspective of the virtual camera at a second location in the scene, wherein the dynamically adjusted synthetic view of the scene is an angularly accurate display of the scene based on the current position of the viewer in the room relative to the fixed position of the display in the room; and
transmit the dynamically adjusted synthetic view of the scene for being displayed on the display such that the scene appears to the viewer as if the real camera recording the scene was located at the current position of the viewer.
1 Assignment
0 Petitions
Accused Products
Abstract
There is provided a system including a non-transitory memory storing an executable code and a hardware processor executing the code to receive a video content including a plurality of frames showing a scene from a perspective of a real camera, create a three-dimensional (3D) model of the scene using the plurality of frames, store the 3D model of the scene in the non-transitory memory, construct a synthetic view of the scene showing additional perspectives from one or more virtual cameras at one or more locations in the scene, transmit the synthetic view of the scene for being displayed on a display, display a scene of the video content on the display, track a position of a viewer moving in a room, and adjust the display of the scene being displayed on the display based on the position of the viewer in the room relative to the display.
-
Citations
16 Claims
-
1. A system comprising:
-
a non-transitory memory storing an executable code; a hardware processor executing the executable code to; receive a video content including a plurality of frames showing a scene from a perspective of a real camera; create a three-dimensional (3D) model of the scene using the plurality of frames; store the 3D model of the scene in the non-transitory memory; construct a synthetic view showing the scene from a first perspective of a virtual camera at a first location in the scene; transmit the synthetic view of the scene for being displayed on a display located at a fixed position in a room; track a position of a viewer in the room relative to the fixed position of the display in the room, using a camera or a wireless identification carried by the viewer, to determine a current position of the viewer in the room as the viewer is moving along a path from a first position in the room to a second position in the room at a distance from the first position; dynamically adjust the synthetic view to show the scene from a second perspective of the virtual camera at a second location in the scene, wherein the dynamically adjusted synthetic view of the scene is an angularly accurate display of the scene based on the current position of the viewer in the room relative to the fixed position of the display in the room; and transmit the dynamically adjusted synthetic view of the scene for being displayed on the display such that the scene appears to the viewer as if the real camera recording the scene was located at the current position of the viewer. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method for use with a system having a non-transitory memory and a hardware processor, the method comprising:
-
receiving, using the hardware processor, a video content including a plurality of frames showing a scene from a perspective of a real camera; creating, using the hardware processor, a three-dimensional (3D) model of the scene using the plurality of frames; storing the 3D model of the scene in the non-transitory memory; constructing, using the hardware processor, a synthetic view showing the scene from a first perspective of a virtual camera at a first location in the scene; transmitting, using the hardware processor, the synthetic view of the scene for being displayed on a display located at a fixed position in a room; tracking a position of a viewer in the room relative to the fixed position of the display in the room, using a camera or a wireless identification carried by the viewer, to determine a current position of the viewer in the room as the viewer is moving along a path from a first position in the room to a second position in the room at a distance from the first position; dynamically adjusting the synthetic view to show the scene from a second perspective of the virtual camera at a second location in the scene, wherein the dynamically adjusted synthetic view of the scene is an angularly accurate display of the scene based on the current position of the viewer in the room relative to the fixed position of the display in the room; and transmitting the dynamically adjusted synthetic view of the scene for being displayed on the display such that the scene appears to the viewer as if the real camera recording the scene was located at the current position of the viewer. - View Dependent Claims (11, 12, 13, 14, 15, 16)
-
Specification