×

Real-time synthetically generated video from still frames

  • US 10,382,799 B1
  • Filed: 10/29/2018
  • Issued: 08/13/2019
  • Est. Priority Date: 07/06/2018
  • Status: Active Grant
First Claim
Patent Images

1. A system for generating synthetic video, the system comprising:

  • one or more memory units for storing instructions; and

    one or more processors configured to execute the instructions to perform operations comprising;

    receiving video data comprising a sequence of image frames;

    normalizing the sequence of image frames;

    generating a sequence of difference images based on the normalized sequence of image frames;

    generating an image sequence generator model based on the sequence of difference images;

    training an autoencoder model using the sequence of difference images, the autoencoder model comprising an encoder model and a decoder model;

    identifying a seed image frame;

    generating a seed difference image based on the seed image frame by using the encoder model to perform a forward-step encoding on the seed image frame;

    generating a sequence of synthetic difference images based on the seed difference image, wherein the sequence of synthetic difference images is generated by iteratively using the image sequence generator model to accept a previous synthetic difference image in the sequence as an input and return a subsequent synthetic difference image as an output, starting from the seed difference image;

    generating a sequence of synthetic normalized image frames based on the sequence of synthetic difference images, by using the decoder model to perform at least one of forward-step or backward-step decoding; and

    generating synthetic video by adding background to the synthetic normalized image frames.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×