×

System and method for immersive and interactive multimedia generation

  • US 10,320,437 B2
  • Filed: 03/03/2016
  • Issued: 06/11/2019
  • Est. Priority Date: 10/24/2014
  • Status: Active Grant
First Claim
Patent Images

1. A foldable apparatus, comprising:

  • at least one camera configured to acquire an image of a physical environment;

    an orientation and position determination module configured to determine a change in orientation and/or position of the apparatus with respect to the physical environment based on the acquired image, to determine depth information of a virtual object based on a pre-determined location of the virtual object and a location of the at least one camera, and to determine depth information of a physical object based on a pre-determined location of the physical object and the location of the at least one camera, and wherein the depth information of the virtual object is associated with a pixel of a first image of the virtual object and the depth information of the physical object is associated with a pixel of a second image of the physical object;

    a graphics and audio rendering module configured to;

    determine rendering of a visual image including the virtual object and the physical object in the physical environment based on their depth information, wherein the depth information of the virtual object is compared with the depth information of the physical object in the physical environment to render the pixel of the first image or the pixel of the second image based on the comparison result; and

    determine a virtual audio source in the physical environment, and based on a distance between the virtual audio source and the physical object in the physical environment, adjust rendering of audio;

    a housing configured to hold the at least one camera and the orientation and position determination module; and

    a first strap attached to the housing and configured to attach the housing to a head of a user of the apparatus.

View all claims
  • 2 Assignments
Timeline View
Assignment View
    ×
    ×