×

Reprojecting holographic video to enhance streaming bandwidth/quality

  • US 10,212,428 B2
  • Filed: 01/11/2017
  • Issued: 02/19/2019
  • Est. Priority Date: 01/11/2017
  • Status: Active Grant
First Claim
Patent Images

1. A computer system for compressing video data, comprising:

  • one or more processors; and

    one or more computer-readable media having stored thereon executable instructions that when executed by the one or more processors configure the computer system to perform at least the following;

    capture successive frames of video from a camera incorporated into a first device, the successive frames of video comprising a previous frame image and a current frame image and including surface (depth) information;

    construct a first 3D representation of a shape of a user'"'"'s environment based on the surface (depth) information of the previous frame image and a first camera location and orientation (pose) of the camera corresponding to the previous frame image;

    project the previous frame image onto the first 3D representation;

    detect a change in the location and orientation (pose) of the camera between the previous frame image and the current frame image and generating current frame camera pose data representative of the location and orientation (pose) of the camera for the current frame image;

    construct a second 3D representation of the shape of the user'"'"'s environment based on a second camera location and orientation (pose) corresponding to the current frame image, the second 3D representation corresponding to the shape of the user'"'"'s environment as viewed from the second location and orientation (pose) of the camera, and render the second 3D representation to generate a re-projected previous frame image as viewed from the second location and orientation (pose) of the camera;

    pass the re-projected previous frame image to a video compressor for computing differences between the re-projected previous frame image and the current frame image; and

    generate compressed video data comprising only the differences between the re-projected previous frame image and the current frame image.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×