Method apparatus and computer program products for performing perspective corrections to a distorted image
First Claim
1. An apparatus having a central processing unit (CPU) and a memory coupled to said CPU to perform perspective correction comprising:
- an image capture mechanism configured to capture a distorted image through a wide-angle lens;
a selection mechanism configured to select a set of control vectors into a set of control points using a function that models said wide-angle lens;
a function generator configured to generate a polynomial transform function that maps said set of control points into a set of reference points; and
a transform engine configured to transform a sub area of said distorted image proximate to said set of control points using said polynomial transform function.
6 Assignments
0 Petitions
Accused Products
Abstract
A method and apparatus for transforming wide angle video into perspective corrected viewing zones which either a single user or multiple users may select, orient and magnify. The present invention first captures a wide angle digital video input by any suitable means. The captured image is then stored in a suitable memory means so portions of the image may be selected at a later time. When a portion of the stored video is selected for viewing, a plurality of discrete viewing vectors in three dimensional space are chosen on the video input and transformed to a plurality of control points in a two dimensional plane or any other suitable surface. The area between these points which is still warped from the original wide angle image capture is then transformed to a perspective corrected field of view. The perspective corrected field of view is then displayed on a suitable displaying apparatus, such as a monitor or head mounted display.
97 Citations
71 Claims
-
1. An apparatus having a central processing unit (CPU) and a memory coupled to said CPU to perform perspective correction comprising:
-
an image capture mechanism configured to capture a distorted image through a wide-angle lens;
a selection mechanism configured to select a set of control vectors into a set of control points using a function that models said wide-angle lens;
a function generator configured to generate a polynomial transform function that maps said set of control points into a set of reference points; and
a transform engine configured to transform a sub area of said distorted image proximate to said set of control points using said polynomial transform function. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A computer program product including:
-
a computer usable data carrier having computer readable code embodied therein for causing a computer to perform perspective correction, said computer readable code including;
computer readable program code configured to cause said computer to effect an image capture mechanism for capturing a distorted image through a wide-angle lens;
computer readable program code configured to cause said computer to effect a selection mechanism configured to select a set of control vectors into a set of control points using a function that models said wide-angle lens;
computer readable program code configured to cause said computer to effect a function generator configured to generate a polynomial transform function that maps said set of control points into a set of reference points; and
computer readable program code configured to cause said computer to effect a transform engine configured to transform a sub area of said distorted image proximate to said set of control points using said polynomial transform function. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. An apparatus for transforming wide angle video signals from live, prerecorded or computer simulated environments into perspective corrected video signals, the apparatus comprising:
-
an image capture mechanism configured to capture a wide angle video input;
a memory electrically coupled to the image capture mechanism to store said wide angle video input;
a processor electrically coupled to the memory and configured to transform a plurality of viewing vectors to a plurality of control points on a portion of said wide angle video input, the processor further configured to transform an area between said plurality of control points to a perspective corrected field of view;
a presentation mechanism electrically coupled to the memory and configured to present said perspective corrected field of view; and
a selection mechanism electrically coupled to the processor and configured to select one or more portions of said wide angle video input for the processor to transform. - View Dependent Claims (20)
-
-
21. An apparatus for correcting the perspective of wide angle video, including:
-
an image capture mechanism configured to receive video information comprising a wide angle view of a scene;
a selection mechanism configured to allow a viewer to identify a plurality of viewing vectors as an area of interest within said wide angle view captured by the image capture mechanism;
a digitizer configured to digitize at least a portion of said wide angle view;
a selection mechanism configured to associate a plurality of control points with said area of interest identified by the viewer;
a transformation mechanism configured to transform an area associated with said plurality of control points into a perspective corrected field of view; and
a presentation mechanism configured to present said perspective corrected field of view to the viewer. - View Dependent Claims (22)
-
-
23. An apparatus for correcting the perspective of wide angle video data comprising:
-
an image capture mechanism configured to receive and store video information representing a wide angle view;
a selection mechanism configured to identify a plurality of viewing vectors as a first area of interest among said video information;
an association mechanism responsive to the selection mechanism configured to associate with the area of interest a plurality of control points; and
a mapping mechanism responsive to the selection mechanism configured to transform a second area associated with the control points from the wide angle view into a predetermined second field of view. - View Dependent Claims (24)
-
-
25. A method for providing perspective corrected images of live, prerecorded or simulated environments from a sequence of image frames, the method comprising steps of:
-
receiving one of a plurality of distorted images from said sequence of image frames;
storing a portion of said one of said plurality of distorted images;
transforming a set of control vectors to a set of control points that defines an area that associates said portion of said one of said plurality of distorted images with a portion of a perspective corrected image;
transforming said portion of said one of said plurality of distorted images associated with said area to said portion of said perspective corrected image;
displaying said portion of said perspective corrected image;
sensing inputted information; and
controlling the transformation and display of said perspective corrected image through said inputted information. - View Dependent Claims (26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40)
-
-
41. An apparatus for transforming a portion of a distorted image within a sequence of image frames from live, prerecorded or computer simulated environments into a portion of a perspective corrected image, the apparatus comprising:
-
an input configured to receive one of a plurality of distorted images from said sequence of image frames;
a memory, coupled to the input, configured to store a portion of said one of said plurality of distorted images;
a processor, coupled to the memory, configured to transform a set of control vectors to a set of control points that defines an area that associates said portion of said one of said plurality of distorted images with a portion of a perspective corrected image, the processor further configured to transform said portion of said one of said plurality of distorted images associated with said area to said portion of said perspective corrected image;
a presentation mechanism, coupled to the memory, configured to present said portion of said perspective corrected image; and
a selection mechanism, coupled to the processor, configured to specify said set of control vectors. - View Dependent Claims (42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56)
-
-
57. A computer program product including:
-
a computer usable data carrier having computer readable code embodied therein for causing a computer to transform a portion of a distorted image within a sequence of image frames from live, prerecorded or computer simulated environments into a portion of a perspective corrected image, said computer readable code including;
computer readable program code configured to cause said computer to effect an input mechanism configured to receive one of a plurality of distorted images from said sequence of image frames;
computer readable program code configured to cause said computer to effect a storage mechanism configured to store a portion of said one of said plurality of distorted images received by the input mechanism;
computer readable program code configured to cause said computer to effect a transformation mechanism configured to transform a set of control vectors to a set of control points that defines an area that associates said portion of said one of said plurality of distorted images with a portion of a perspective corrected image, the processor further configured to transform said portion of said one of said plurality of distorted images associated with said area to said portion of said perspective corrected image;
computer readable program code configured to cause said computer to effect a presentation mechanism, configured to present said portion of said perspective corrected image generated by the transformation mechanism; and
computer readable program code configured to cause said computer to effect a selection mechanism configured to specify said set of control vectors. - View Dependent Claims (58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71)
-
Specification