×

Virtual video projection system to synch animation sequences

  • US 10,657,729 B2
  • Filed: 10/18/2018
  • Issued: 05/19/2020
  • Est. Priority Date: 10/18/2018
  • Status: Active Grant
First Claim
Patent Images

1. A method of synchronizing an animation sequence with a video footage, the method comprising:

  • obtaining a digital three-dimensional (3D) model of a site captured in the video footage by a video camera installed in the site, the video camera having a set of camera parameters;

    identifying a plurality of key frames of the video footage, wherein a moving object is at a respective position in a respective key frame of the plurality of key frames;

    placing a first virtual camera in the digital 3D model at a first location and a first orientation corresponding to a location and an orientation of the video camera in the site, the first virtual camera having a first set of virtual camera parameters, at least some virtual camera parameters of the first set of virtual camera parameters are same as some corresponding camera parameters of the set of camera parameters of the video camera;

    generating a first set of virtual frames of the animation sequence by projecting the digital 3D model onto a first scene frame from a viewpoint of the first virtual camera using the first set of virtual camera parameters, the first set of virtual frames including a first plurality of virtual key frames, each virtual key frame corresponding to a respective key frame in the video footage;

    rendering at least a subset of a set of pixels of the video footage in each virtual frame of the first set of virtual frames;

    for each respective virtual key frame, placing a virtual object corresponding to the moving object at a respective location in the digital 3D model that matches with the respective position of the moving object in a corresponding key frame; and

    playing the first set of virtual frames of the animation sequence while the video footage is overlaid on the subset of the set of pixels, wherein the animation sequence and the video footage are played simultaneously by stepping through time such that the first plurality of virtual key frames is in synch with the plurality of key frames of the video footage.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×