Virtual reality environment based manipulation of multi-layered multi-view interactive digital media representations
First Claim
1. A method for generating multi-view interactive digital media representations in a virtual reality environment comprising:
- obtaining a plurality of images having location information and an object, wherein the plurality of images include at least a portion of overlapping subject matter;
fusing, via a processor, the plurality of images to generate a content model and a context model, wherein the content model includes a multi-view interactive digital media representation of the object and the context model includes a multi-view interactive digital media representation of scenery surrounding the object, wherein the multi-view interactive digital media representations are generated via stitching together two-dimensional images such that the stitched two-dimensional images are experienced as a three dimensional view that is also 360 degree rotatable without actually rendering or generating an actual three-dimensional model, wherein the content model is generated using surround view based object segmentation such that the content model is treated as a separate entity, wherein the content model occupies a three-dimensional space such that a user can circle around the object, wherein the content model is generated using a first set of images with overlapping subject matter and the context model is generated using a second set of images with overlapping subject matter, wherein the first set and the second sets are generated independently and do not have overlapping subject matter between the sets; and
generating, via the processor, a virtual reality environment using the content model and the context model;
wherein the multi-view interactive digital media representations are configured such that the user can manipulate the content model separately within the virtual reality environment without moving or manipulating the context model and wherein the user can also maneuver within the virtual reality environment causing both the context model and the content model to change views simultaneously.
1 Assignment
0 Petitions
Accused Products
Abstract
Various embodiments of the present disclosure relate generally to systems and methods for generating multi-view interactive digital media representations in a virtual reality environment. According to particular embodiments, a plurality of images is fused into a first content model and a first context model, both of which include multi-view interactive digital media representations of s. Next, a virtual reality environment is generated using the first content model and the first context model. The virtual reality environment includes a first layer and a second layer. The user can navigate through and within the virtual reality environment to switch between multiple viewpoints of the content model via corresponding physical movements. The first layer includes the first content model and the second layer includes a second content model and wherein selection of the first layer provides access to the second layer with the second content model.
-
Citations
20 Claims
-
1. A method for generating multi-view interactive digital media representations in a virtual reality environment comprising:
-
obtaining a plurality of images having location information and an object, wherein the plurality of images include at least a portion of overlapping subject matter; fusing, via a processor, the plurality of images to generate a content model and a context model, wherein the content model includes a multi-view interactive digital media representation of the object and the context model includes a multi-view interactive digital media representation of scenery surrounding the object, wherein the multi-view interactive digital media representations are generated via stitching together two-dimensional images such that the stitched two-dimensional images are experienced as a three dimensional view that is also 360 degree rotatable without actually rendering or generating an actual three-dimensional model, wherein the content model is generated using surround view based object segmentation such that the content model is treated as a separate entity, wherein the content model occupies a three-dimensional space such that a user can circle around the object, wherein the content model is generated using a first set of images with overlapping subject matter and the context model is generated using a second set of images with overlapping subject matter, wherein the first set and the second sets are generated independently and do not have overlapping subject matter between the sets; and generating, via the processor, a virtual reality environment using the content model and the context model; wherein the multi-view interactive digital media representations are configured such that the user can manipulate the content model separately within the virtual reality environment without moving or manipulating the context model and wherein the user can also maneuver within the virtual reality environment causing both the context model and the content model to change views simultaneously. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system for generating multi-view interactive digital media representations in a virtual reality environment comprising:
-
a processor; and memory, the memory comprising instructions for; obtaining a plurality of images having location information and an object, wherein the plurality of images include at least a portion of overlapping subject matter; fusing, via a processor, the plurality of images to generate a content model and a context model, wherein the content model includes a multi-view interactive digital media representation of the object and the context model includes a multi-view interactive digital media representation of scenery surrounding the object, wherein the multi-view interactive digital media representations are generated via stitching together two-dimensional images such that the stitched two-dimensional images are experienced as a three dimensional view that is also 360 degree rotatable without actually rendering or generating an actual three- dimensional model, wherein the content model is generated using surround view based object segmentation such that the content model is treated as a separate entity, wherein the content model occupies a three-dimensional space such that a user can circle around the object, wherein the content model is generated using a first set of images with overlapping subject matter and the context model is generated using a second set of images with overlapping subject matter, wherein the first set and the second sets are generated independently and do not have overlapping subject matter between the sets; and generating, via the processor, a virtual reality environment using the content model and the context model; wherein the multi-view interactive digital media representations are configured such that the user can manipulate the content model separately within the virtual reality environment without moving or manipulating the context model and wherein the user can also maneuver within the virtual reality environment causing both the context model and the content model to change views simultaneously. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer readable medium comprising instructions to execute a method for generating multi-view interactive digital media representations in a virtual reality environment, the method comprising:
-
obtaining a plurality of images having location information and an object, wherein the plurality of images include at least a portion of overlapping subject matter; fusing, via a processor, the plurality of images to generate a content model and a context model, wherein the content model includes a multi-view interactive digital media representation of the object and the context model includes a multi-view interactive digital media representation of scenery surrounding the object, wherein the multi-view interactive digital media representations are generated via stitching together two-dimensional images such that the stitched two-dimensional images are experienced as a three dimensional view that is also 360 degree rotatable without actually rendering or generating an actual three-dimensional model, wherein the content model is generated using surround view based object segmentation such that the content model is treated as a separate entity, wherein the content model occupies a three-dimensional space such that a user can circle around the object, wherein the content model is generated using a first set of images with overlapping subject matter and the context model is generated using a second set of images with overlapping subject matter, wherein the first set and the second sets are generated independently and do not have overlapping subject matter between the sets; and generating, via the processor, a virtual reality environment using the content model and the context model; wherein the multi-view interactive digital media representations are configured such that the user can manipulate the content model separately within the virtual reality environment without moving or manipulating the context model and wherein the user can also maneuver within the virtual reality environment causing both the context model and the content model to change views simultaneously. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification