Display techniques for three-dimensional virtual reality
First Claim
1. A method for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image texture-mapped on a panel, said two-dimensional image including an object depicted in perspective, said image being such that features of the object closer to a predetermined point of the image are farther away from a user'"'"'s viewpoint, comprising the steps of:
- segmenting the two-dimensional image into a plurality of sections;
setting the pixel resolution of each of said plurality of sections according to its location within the two-dimensional image;
determining a vector, {overscore (C)}, corresponding to the direction of said perspective object in the three-dimensional world;
projecting towards said panel the vector, {overscore (C)}, from the two-dimensional image'"'"'s ideal viewing point, IVP, the intersection of said vector, {overscore (C)}, with the panel being denoted as the image'"'"'s vanishing point, P;
segmenting said panel into triangular regions intersecting at the image'"'"'s vanishing point, P;
determining the current viewpoint, V, of the user and projecting a vector, {overscore (T)}, from the image'"'"'s ideal viewing point, IVP, to the current viewpoint, V;
determining a new vanishing point for the two-dimensional image in accordance with the following relationship P′
=P+{overscore (T)};
distorting the triangular regions in the space of the three-dimensional world such that they intersect at the new vanishing point, P′
;
texture-mapping the two-dimensional image in the triangular regions onto said distorted triangular regions; and
displaying the computer graphics along with the two-dimensional image.
7 Assignments
0 Petitions
Accused Products
Abstract
A limitation of using two-dimensional images, such as videos or photographs, to represent portions of a three-dimensional world occurs when the user moves within the world and views the world from a location different than from the original context of the two-dimensional image, i.e., from a location different than the image'"'"'s ideal viewing point (IVP). View changes result in the image not aligning well with the surrounding objects of the three-dimensional world. This limitation is overcome by distorting the two-dimensional image so as to adjust the image'"'"'s vanishing point(s) in accordance with the movement of the user using a pyramidic panel structure. In this manner, as the user moves away from the ideal viewing point, the distortions act to limit the discontinuities between the two-dimensional image and its surroundings. To minimize the depth profile of the pyramidic panel structure, the structure may be segmented into sections and each section translated towards, or away from, the user'"'"'s viewpoint. Also, a hierarchical image resolution may be used, with portions of the image near the center or vanishing point having a higher resolution than the portions of the image near its perimeter.
145 Citations
15 Claims
-
1. A method for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image texture-mapped on a panel, said two-dimensional image including an object depicted in perspective, said image being such that features of the object closer to a predetermined point of the image are farther away from a user'"'"'s viewpoint, comprising the steps of:
-
segmenting the two-dimensional image into a plurality of sections;
setting the pixel resolution of each of said plurality of sections according to its location within the two-dimensional image;
determining a vector, {overscore (C)}, corresponding to the direction of said perspective object in the three-dimensional world;
projecting towards said panel the vector, {overscore (C)}, from the two-dimensional image'"'"'s ideal viewing point, IVP, the intersection of said vector, {overscore (C)}, with the panel being denoted as the image'"'"'s vanishing point, P;
segmenting said panel into triangular regions intersecting at the image'"'"'s vanishing point, P;
determining the current viewpoint, V, of the user and projecting a vector, {overscore (T)}, from the image'"'"'s ideal viewing point, IVP, to the current viewpoint, V;
determining a new vanishing point for the two-dimensional image in accordance with the following relationship P′
=P+{overscore (T)};
distorting the triangular regions in the space of the three-dimensional world such that they intersect at the new vanishing point, P′
;
texture-mapping the two-dimensional image in the triangular regions onto said distorted triangular regions; and
displaying the computer graphics along with the two-dimensional image. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method for use in processing a view of a three-dimensional world in which a first portion of said world is modeled as computer graphics and a second portion of said world is represented by a two-dimensional image texture-mapped on a panel, comprising the steps of:
-
determining the current viewpoint of the user, V;
dividing the panel into triangular regions;
distorting the triangular regions to form pyramidic panels such that a corresponding vanishing point, P, of a portion of the two-dimensional image moves as a function of the current viewpoint of the user;
segmenting each of said pyramidic panels into a plurality of sections;
translating each of said plurality of sections of said pyramidic panels towards, or away from, said current viewpoint of the user, V;
segmenting the two-dimensional image into sections;
adjusting the pixel resolution in each of said sections of the two-dimensional image according to its location relative to the center of the two-dimensional image;
texture-mapping the two-dimensional image onto the plurality of sections of the pyramidic panels;
scaling each of said plurality of sections of said pyramidic panels in accordance with the following relationship St=SpTt/Tp, where Sp is the size of the section;
St is the size of the translated section;
Tp is distance to the section from the user'"'"'s viewpoint, V; and
Tt is the distance to the translated section from the user'"'"'s viewpoint, V; and
displaying the computer graphics along with the two-dimensional image. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13, 14, 15)
-
Specification