ROLLING SHUTTER RECTIFICATION IN IMAGES/VIDEOS USING CONVOLUTIONAL NEURAL NETWORKS WITH APPLICATIONS TO SFM/SLAM WITH ROLLING SHUTTER IMAGES/VIDEOS
First Claim
Patent Images
1. A computer-implemented method executed on a processor for correcting rolling shutter (RS) effects, the method comprising:
- generating a plurality of images from a camera;
synthesizing RS images from global shutter (GS) counterparts to generate training data to train the structure-and-motion-aware convolutional neural network (CNN); and
predicting an RS camera motion and an RS depth map from a single RS image by employing a structure-and-motion-aware CNN to remove RS distortions from the single RS image.
3 Assignments
0 Petitions
Accused Products
Abstract
A method for correcting rolling shutter (RS) effects is presented. The method includes generating a plurality of images from a camera, synthesizing RS images from global shutter (GS) counterparts to generate training data to train the structure-and-motion-aware convolutional neural network (CNN), and predicting an RS camera motion and an RS depth map from a single RS image by employing a structure-and-motion-aware CNN to remove RS distortions from the single RS image.
-
Citations
20 Claims
-
1. A computer-implemented method executed on a processor for correcting rolling shutter (RS) effects, the method comprising:
-
generating a plurality of images from a camera; synthesizing RS images from global shutter (GS) counterparts to generate training data to train the structure-and-motion-aware convolutional neural network (CNN); and predicting an RS camera motion and an RS depth map from a single RS image by employing a structure-and-motion-aware CNN to remove RS distortions from the single RS image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A non-transitory computer-readable storage medium comprising a computer-readable program for correcting rolling shutter (RS) effects, wherein the computer-readable program when executed on a computer causes the computer to perform the steps of:
-
generating a plurality of images from a camera; synthesizing RS images from global shutter (GS) counterparts to generate training data to train the structure-and-motion-aware convolutional neural network (CNN); and predicting an RS camera motion and an RS depth map from a single RS image by employing a structure-and-motion-aware CNN to remove RS distortions from the single RS image. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A system for correcting rolling shutter (RS) effects, the system comprising:
-
a memory; and one or more processors in communication with the memory configured to; generate a plurality of images from a camera; synthesize RS images from global shutter (GS) counterparts to generate training data to train the structure-and-motion-aware convolutional neural network (CNN); and predict an RS camera motion and an RS depth map from a single RS image by employing a structure-and-motion-aware CNN to remove RS distortions from the single RS image. - View Dependent Claims (18, 19, 20)
-
Specification