×

Virtual reality environment based manipulation of multi-layered multi-view interactive digital media representations

  • US 10,725,609 B2
  • Filed: 10/03/2017
  • Issued: 07/28/2020
  • Est. Priority Date: 07/15/2015
  • Status: Active Grant
First Claim
Patent Images

1. A method for generating multi-view interactive digital media representations in a virtual reality environment comprising:

  • obtaining a plurality of images having location information and an object, wherein the plurality of images include at least a portion of overlapping subject matter;

    fusing, via a processor, the plurality of images to generate a content model and a context model, wherein the content model includes a multi-view interactive digital media representation of the object and the context model includes a multi-view interactive digital media representation of scenery surrounding the object, wherein the multi-view interactive digital media representations are generated via stitching together two-dimensional images such that the stitched two-dimensional images are experienced as a three dimensional view that is also 360 degree rotatable without actually rendering or generating an actual three-dimensional model, wherein the content model is generated using surround view based object segmentation such that the content model is treated as a separate entity, wherein the content model occupies a three-dimensional space such that a user can circle around the object, wherein the content model is generated using a first set of images with overlapping subject matter and the context model is generated using a second set of images with overlapping subject matter, wherein the first set and the second sets are generated independently and do not have overlapping subject matter between the sets; and

    generating, via the processor, a virtual reality environment using the content model and the context model;

    wherein the multi-view interactive digital media representations are configured such that the user can manipulate the content model separately within the virtual reality environment without moving or manipulating the context model and wherein the user can also maneuver within the virtual reality environment causing both the context model and the content model to change views simultaneously.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×