Discontinuity-aware reprojection
First Claim
1. A system for reprojecting three-dimensional (3D) virtual scenes using discontinuity depth late stage reprojection, the system comprising:
- one or more processors and memory configured for providing computer program instructions to the one or more processors;
a reprojection engine configured to;
access a reconstruction point that indicates camera pose information associated with a 3D virtual scene, the 3D virtual scene is associated with a plurality of sample points each having a cube map of color data and depth data;
identify one or more closest sample points relative to the reconstruction point, the one or more closest sample points is identified from the plurality of sample points;
determine a relative convergence score generated for each of the one or more closest sample points based on performing a depth-aware cube map late stage projection operation for each of the one or more closest sample points in relation to the reconstruction point, wherein the relative convergence score is an indicator of a capacity of a sample point to reconstruct at least portions of the 3D virtual scene from the reconstruction point;
identifying a subset of the one or more closest sample points based on eliminating one or more of the one or more closest sample points based on the relative convergence score; and
generating a reconstructed 3D virtual scene using the subset of the one or more closest sample points.
1 Assignment
0 Petitions
Accused Products
Abstract
In various embodiments, methods and systems reprojecting three-dimensional (3D) virtual scenes using discontinuity depth late stage reprojection are provided. A reconstruction point, that indicates camera pose information, is accessed. The reconstruction point is associated with a plurality of sample points of a three-dimensional (3D) virtual scene. One or more closest sample points, relative to the reconstruction point, are identified, from the plurality of sample points. Each of the one or more closest sample points is associated with a cube map of color data and depth data. A relative convergence score is determined for each of the one or more closest sample points based on performing a depth-aware cube map late stage reprojection operation in relation to the reconstruction point. A subset of the one or more closest sample points is identified based on the relative convergence score. A reconstructed 3D virtual image is generated using the subset.
-
Citations
20 Claims
-
1. A system for reprojecting three-dimensional (3D) virtual scenes using discontinuity depth late stage reprojection, the system comprising:
-
one or more processors and memory configured for providing computer program instructions to the one or more processors; a reprojection engine configured to; access a reconstruction point that indicates camera pose information associated with a 3D virtual scene, the 3D virtual scene is associated with a plurality of sample points each having a cube map of color data and depth data; identify one or more closest sample points relative to the reconstruction point, the one or more closest sample points is identified from the plurality of sample points; determine a relative convergence score generated for each of the one or more closest sample points based on performing a depth-aware cube map late stage projection operation for each of the one or more closest sample points in relation to the reconstruction point, wherein the relative convergence score is an indicator of a capacity of a sample point to reconstruct at least portions of the 3D virtual scene from the reconstruction point; identifying a subset of the one or more closest sample points based on eliminating one or more of the one or more closest sample points based on the relative convergence score; and generating a reconstructed 3D virtual scene using the subset of the one or more closest sample points. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A computer-implemented method for reprojecting three-dimensional (3D) virtual scenes using discontinuity depth late stage reprojection, the method comprising:
-
accessing a reconstruction point that indicates camera pose information associated with a 3D virtual scene, the 3D virtual scene is associated with a plurality of sample points each having a cube map of color data and depth data; identifying a first selected sample point from the plurality of sample points, wherein the first selected sample point is a closest sample point relative to the reconstruction point; determining a dis-occlusion associated with generating a reconstructed 3D virtual scene from the reconstruction point, wherein the dis-occlusion is determined based on performing a depth-aware cube map late stage projection operation for first selected sample point in relation to reference point; identifying a second selected sample point, from the plurality of sample points, for resolving the dis-occlusion, wherein the second selected sample point is a second closest sample point relative to the reconstruction point; and generating a corresponding first portion and second portion of the reconstructed 3D virtual scene using the first selected sample point and the second selected sample point based on performing the depth-aware cube map late stage projection operation on the first selected sample point and the second selected sample point in relation to the reference point. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. One or more computer storage media having computer-executable instructions embodied thereon that, when executed, by one or more processors, causes the one or more processors to perform a method for reprojecting images based on three-dimensional (3D) virtual images using discontinuity and depth late stage reprojection, the method comprising:
-
referencing a reconstruction point that indicates camera pose information associated with a 3D virtual scene, the 3D virtual scene is associated with a plurality of sample points each having a cube map of color data and depth data; identifying a first closest sample point of the reconstruction point, the first closest sample point is selected from the plurality of sample points; determining a dis-occlusion associated with generating a reconstructed 3D virtual scene from the reconstruction point, wherein the dis-occlusion is determined based on performing a depth-aware cube map late stage projection operation for first closest sample point in relation to reference point, wherein the dis-occlusion is associated with one of a first stereoscopic view or a second stereoscopic view of the reconstruction point; identifying a second closest sample point of the reconstruction point, the second closest sample point is selected from the plurality of sample points; and reconstructing the dis-occlusion using the second closest sample point based on performing a depth-aware cube map late stage projection process based on the second closest sample point in relation to the reference point. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification