Virtual lens simulation for video and photo cropping
DCFirst Claim
Patent Images
1. A system that simulates image distortion of a virtual lens in a video, the system comprising:
- one or more processors; and
a non-transitory computer-readable storage medium storing instructions that when executed cause the one or more processors to perform steps including;
accessing input images, the input images including fields of view of a scene captured through a lens of a camera, the input images depicting the scene with an input lens distortion centered in the fields of view;
selecting sub-frames representing portions of the input images, the sub-frames including reduced fields of view of the scene smaller than the fields of view of the input images, the sub-frames including different lens distortion effects as a function of the input lens distortion present in the input images, different positions of areas of the input images included within the reduced fields of view, and a size of the areas of the input images included within the reduced fields of view; and
generating output images based on a desired lens distortion and the different lens distortion effects in the sub-frames, the desired lens distortion and the input lens distortion exhibiting consistent lens characteristics, wherein the output images include the sub-frames remapped from the input lens distortion centered in the fields of view of the input images to the desired lens distortion centered in the reduced fields of view to transform the different lens distortion effects present in the sub-frames to the desired lens distortion such that portions of the scene depicted in the sub-frames appear to have been captured using the reduced fields of view.
3 Assignments
Litigations
0 Petitions
Accused Products
Abstract
In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
-
Citations
20 Claims
-
1. A system that simulates image distortion of a virtual lens in a video, the system comprising:
-
one or more processors; and a non-transitory computer-readable storage medium storing instructions that when executed cause the one or more processors to perform steps including; accessing input images, the input images including fields of view of a scene captured through a lens of a camera, the input images depicting the scene with an input lens distortion centered in the fields of view; selecting sub-frames representing portions of the input images, the sub-frames including reduced fields of view of the scene smaller than the fields of view of the input images, the sub-frames including different lens distortion effects as a function of the input lens distortion present in the input images, different positions of areas of the input images included within the reduced fields of view, and a size of the areas of the input images included within the reduced fields of view; and generating output images based on a desired lens distortion and the different lens distortion effects in the sub-frames, the desired lens distortion and the input lens distortion exhibiting consistent lens characteristics, wherein the output images include the sub-frames remapped from the input lens distortion centered in the fields of view of the input images to the desired lens distortion centered in the reduced fields of view to transform the different lens distortion effects present in the sub-frames to the desired lens distortion such that portions of the scene depicted in the sub-frames appear to have been captured using the reduced fields of view. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for simulating image distortion of a virtual lens in a video, the method comprising:
-
accessing input images, the input images including fields of view of a scene captured through a lens of a camera, the input images depicting the scene with an input lens distortion centered in the fields of view; selecting sub-frames representing portions of the input images, the sub-frames including reduced fields of view of the scene smaller than the fields of view of the input images, the sub-frames including different lens distortion effects as a function of the input lens distortion present in the input images, different positions of areas of the input images included within the reduced fields of view, and a size of the areas of the input images included within the reduced fields of view; and generating output images based on a desired lens distortion and the different lens distortion effects in the sub-frames, the desired lens distortion and the input lens distortion exhibiting consistent lens characteristics, wherein the output images include the sub-frames remapped from the input lens distortion centered in the fields of view of the input images to the desired lens distortion centered in the reduced fields of view to transform the different lens distortion effects present in the sub-frames to the desired lens distortion such that portions of the scene depicted in the sub-frames appear to have been captured using the reduced fields of view. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification