Image capture for virtual reality displays
First Claim
1. A method for generating a virtual view of an environment, the method comprising:
- with a light-field camera system, capturing video data depicting the environment, the video data comprising a plurality of subviews that provide a plurality of views of the environment;
computing estimated world properties of the environment;
for each of the subviews, generating a confidence map indicative of a level of confidence in the estimated world properties of each of a plurality of regions within the subview, wherein generating the confidence map comprises generating a tertiary confidence map for a tertiary subview; and
using the subviews and the confidence maps to generate the virtual view, wherein using the subviews and the confidence maps comprises selecting, for inclusion in the virtual view, one or more regions of the tertiary subview having higher confidence in the tertiary confidence map than corresponding regions of a secondary confidence map.
2 Assignments
0 Petitions
Accused Products
Abstract
A light-field camera system such as a tiled camera array may be used to capture a light-field of an environment. The tiled camera array may be a tiered camera array with a first plurality of cameras and a second plurality of cameras that are arranged more densely, but have lower resolution, than those of the first plurality of cameras. The first plurality of cameras may be interspersed among the second plurality of cameras. The first and second pluralities may cooperate to capture the light-field. According to one method, a subview may be captured by each camera of the first and second pluralities. Estimated world properties of the environment may be computed for each subview. A confidence map may be generated to indicate a level of confidence in the estimated world properties for each subview. The confidence maps and subviews may be used to generate a virtual view of the environment.
-
Citations
30 Claims
-
1. A method for generating a virtual view of an environment, the method comprising:
-
with a light-field camera system, capturing video data depicting the environment, the video data comprising a plurality of subviews that provide a plurality of views of the environment; computing estimated world properties of the environment; for each of the subviews, generating a confidence map indicative of a level of confidence in the estimated world properties of each of a plurality of regions within the subview, wherein generating the confidence map comprises generating a tertiary confidence map for a tertiary subview; and using the subviews and the confidence maps to generate the virtual view, wherein using the subviews and the confidence maps comprises selecting, for inclusion in the virtual view, one or more regions of the tertiary subview having higher confidence in the tertiary confidence map than corresponding regions of a secondary confidence map. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A non-transitory computer-readable medium for generating a virtual view of an environment, the non-transitory computer-readable medium comprising instructions stored thereon, that when executed by a processor, perform the steps of:
-
receiving video data depicting the environment after capture of the video data by a light-field camera system, the video data comprising a plurality of subviews that provide a plurality of views of the environment; computing estimated world properties of the environment; for each of the subviews, generating a confidence map indicative of a level of confidence in the estimated world properties of each of a plurality of regions within the subview, wherein generating the confidence map comprises generating a tertiary confidence map for a tertiary subview; and using the subviews and the confidence maps to generate the virtual view, wherein using the subviews and the confidence maps comprises selecting, for inclusion in the virtual view, one or more regions of the tertiary subview having higher confidence in the tertiary confidence map than corresponding regions of a secondary confidence map. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A system for generating a virtual view of an environment, the system comprising:
-
a light-field camera system configured to capture video data depicting the environment, the video data comprising a plurality of subviews that provide a plurality of views of the environment; and a processor configured to; compute estimated world properties of the environment; for each of the subviews, generate a confidence map indicative of a level of confidence in the estimated world properties of each of a plurality of regions within the subview, wherein the processor is further configured to generate the confidence map for each of the plurality of subviews by generating a tertiary confidence map for a tertiary subview; use the subviews and the confidence maps to generate the virtual view, wherein the processor is further configured to use the confidence maps and the subviews to generate the virtual view by selecting, for inclusion in the virtual view, one or more regions of the tertiary subview having higher confidence in the tertiary confidence map than corresponding regions of a secondary confidence map. - View Dependent Claims (23, 24, 25, 26, 27, 28, 29, 30)
-
Specification