Virtual lens simulation for video and photo cropping
First Claim
Patent Images
1. A method for simulating a virtual lens when applying a crop or zoom effect to an input image, the method comprising:
- receiving, by a processor, the input image, the input image having a first field of view of a scene, the input image depicting the scene with an input lens distortion centered in the first field of view, the input lens distortion caused by lens characteristics of a lens used to capture the input image, the lens centered at the first field of view during capture of the input image;
identifying, by the processor, the input lens distortion within the input image;
obtaining, by the processor, a selection of a sub-frame representing a portion of the input image, the sub-frame having a second field of view of the scene smaller than the first field of view;
determining, by the processor, an input lens distortion effect present in the sub-frame based on the input lens distortion centered in the first field of view, a location of the sub-frame within the first field of view, and a size of the second field of view; and
generating, by the processor, an output image based on the input lens distortion and the input lens distortion effect present in the sub-frame, the output image including the sub-frame remapped from the input lens distortion centered in the first field of view to the input lens distortion centered in the second field of view such that a portion of the scene depicted in the sub-frame appears to have been captured using the lens centered at the second field of view.
4 Assignments
0 Petitions
Accused Products
Abstract
In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion caused by a lens used to capture the input video frame. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is the outputted.
-
Citations
20 Claims
-
1. A method for simulating a virtual lens when applying a crop or zoom effect to an input image, the method comprising:
-
receiving, by a processor, the input image, the input image having a first field of view of a scene, the input image depicting the scene with an input lens distortion centered in the first field of view, the input lens distortion caused by lens characteristics of a lens used to capture the input image, the lens centered at the first field of view during capture of the input image; identifying, by the processor, the input lens distortion within the input image; obtaining, by the processor, a selection of a sub-frame representing a portion of the input image, the sub-frame having a second field of view of the scene smaller than the first field of view; determining, by the processor, an input lens distortion effect present in the sub-frame based on the input lens distortion centered in the first field of view, a location of the sub-frame within the first field of view, and a size of the second field of view; and generating, by the processor, an output image based on the input lens distortion and the input lens distortion effect present in the sub-frame, the output image including the sub-frame remapped from the input lens distortion centered in the first field of view to the input lens distortion centered in the second field of view such that a portion of the scene depicted in the sub-frame appears to have been captured using the lens centered at the second field of view. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A non-transitory computer-readable storage medium storing instructions for simulating a virtual lens when applying a crop or zoom effect to an input image, the instructions when executed by one or more processors causing the one or more processors to perform steps including:
-
receiving the input image, the input image having a first field of view of a scene, the input image depicting the scene with an input lens distortion centered in the first field of view, the input lens distortion caused by lens characteristics of a lens used to capture the input image, the lens centered at the first field of view during capture of the input image; identifying the input lens distortion within the input image; obtaining a selection of a sub-frame representing a portion of the input image, the sub-frame having a second field of view of the scene smaller than the first field of view; determining an input lens distortion effect present in the sub-frame based on the input lens distortion centered in the first field of view, a location of the sub-frame within the first field of view, and a size of the second field of view; and generating an output image based on the input lens distortion and the input lens distortion effect present in the sub-frame, the output image including the sub-frame remapped from the input lens distortion centered in the first field of view to the input lens distortion centered in the second field of view such that a portion of the scene depicted in the sub-frame appears to have been captured using the lens centered at the second field of view. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A system for simulating a virtual lens when applying a crop or zoom effect to an input image, the system comprising:
-
one or more processors; and a non-transitory computer-readable storage medium storing instructions for simulating the virtual lens when applying a crop or zoom effect to the input image, the instructions when executed by one or more processors causing the one or more processors to perform steps including; receiving the input image, the input image having a first field of view of a scene, the input image depicting the scene with an input lens distortion centered in the first field of view, the input lens distortion caused by lens characteristics of a lens used to capture the input image, the lens centered at the first field of view during capture of the input image; identifying the input lens distortion within the input image; obtaining a selection of a sub-frame representing a portion of the input image, the sub-frame having a second field of view of the scene smaller than the first field of view; determining an input lens distortion effect present in the sub-frame based on the input lens distortion centered in the first field of view, a location of the sub-frame within the first field of view, and a size of the second field of view; and generating an output image based on the input lens distortion and the input lens distortion effect present in the sub-frame, the output image including the sub-frame remapped from the input lens distortion centered in the first field of view to the input lens distortion centered in the second field of view such that a portion of the scene depicted in the sub-frame appears to have been captured using the lens centered at the second field of view. - View Dependent Claims (18, 19, 20)
-
Specification