Virtual lens simulation for video and photo cropping
First Claim
Patent Images
1. A system that simulates image distortion of a virtual lens in an image, the system comprising:
- one or more processors; and
a non-transitory computer-readable storage medium storing instructions that when executed cause the one or more processors to perform steps including;
accessing an input image, the input image including a first field of view of a scene, the input image depicting the scene with an input lens distortion centered in the first field of view;
selecting a sub-frame representing a portion of the input image, the sub-frame including a second field of view of the scene smaller than the first field of view, the sub-frame including a lens distortion effect as a function of the input lens distortion present in the input image, a position of an area of the input image included within the second field of view, and a size of the area of the input image included within the second field of view; and
generating an output image based on a desired lens distortion and the lens distortion effect in the sub-frame, the desired lens distortion and the input lens distortion exhibiting consistent lens characteristics, wherein the output image includes the sub-frame remapped from the input lens distortion centered in the first field of view to the desired lens distortion centered in the second field of view to transform the lens distortion effect present in the sub-frame to the desired lens distortion such that a portion of the scene depicted in the sub-frame appears to have been captured using the second field of view.
3 Assignments
0 Petitions
Accused Products
Abstract
In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
176 Citations
20 Claims
-
1. A system that simulates image distortion of a virtual lens in an image, the system comprising:
-
one or more processors; and a non-transitory computer-readable storage medium storing instructions that when executed cause the one or more processors to perform steps including; accessing an input image, the input image including a first field of view of a scene, the input image depicting the scene with an input lens distortion centered in the first field of view; selecting a sub-frame representing a portion of the input image, the sub-frame including a second field of view of the scene smaller than the first field of view, the sub-frame including a lens distortion effect as a function of the input lens distortion present in the input image, a position of an area of the input image included within the second field of view, and a size of the area of the input image included within the second field of view; and generating an output image based on a desired lens distortion and the lens distortion effect in the sub-frame, the desired lens distortion and the input lens distortion exhibiting consistent lens characteristics, wherein the output image includes the sub-frame remapped from the input lens distortion centered in the first field of view to the desired lens distortion centered in the second field of view to transform the lens distortion effect present in the sub-frame to the desired lens distortion such that a portion of the scene depicted in the sub-frame appears to have been captured using the second field of view. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for simulating image distortion of a virtual lens in an image, the method comprising:
-
accessing an input image, the input image including a first field of view of a scene, the input image depicting the scene with an input lens distortion centered in the first field of view; selecting a sub-frame representing a portion of the input image, the sub-frame including a second field of view of the scene smaller than the first field of view, the sub-frame including a lens distortion effect as a function of the input lens distortion present in the input image, a position of an area of the input image included within the second field of view, and a size of the area of the input image included within the second field of view; and generating an output image based on a desired lens distortion and the lens distortion effect in the sub-frame, the desired lens distortion and the input lens distortion exhibiting consistent lens characteristics, wherein the output image includes the sub-frame remapped from the input lens distortion centered in the first field of view to the desired lens distortion centered in the second field of view to transform the lens distortion effect present in the sub-frame to the desired lens distortion such that a portion of the scene depicted in the sub-frame appears to have been captured using the second field of view. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification