Imaging surface modeling for camera modeling and virtual view synthesis
First Claim
Patent Images
1. A method of displaying a captured image on a display device comprising the steps of:
- capturing a real image by an image capture device, the image capture device using a field-of-view lens that distorts the real image;
applying a camera model to the captured real image, the camera model mapping objects in the captured real image to an image sensor plane of the image capture device to generate a virtual image, the image sensor plane reconfigured to virtually alter a shape of the image sensor plane to a non-planar surface; and
projecting the virtual image formed on the non-planar image surface of the image sensor to the display device;
wherein generating the virtual image comprises the steps of;
providing a pre-calibrated real camera model by the processor, the real camera model representative of the vision-based imaging device capturing the scene;
determining real incident ray angles of each pixel in the captured image based on the pre-calibrated real camera model;
identifying an arbitrary shape of the non-planar imaging surfaceidentifying a pose of the virtual camera model;
determining virtual incident ray angles of each pixel in the virtual image based on the virtual image model and the non-planar imaging surface;
mapping a virtual incident ray to a correlated real incident ray of the real image capture device, wherein rotational compensation is applied to the virtual incident ray angles for correlating the virtual incident ray and the real incident ray if a pose of the virtual camera model is different from a pose of the of the real image capture device;
mapping pixels in the virtual image corresponding to coordinates on the non-planar virtual imaging surface to correlated pixels on the real captured image as a function of the correlation mapping between the real incident ray and the virtual incident ray, and wherein a horizontal projection of a virtual incident angle θ
virt is represented by the angle α
, wherein angle α
is represented by the following formula;
0 Assignments
0 Petitions
Accused Products
Abstract
A method of displaying a captured image on a display device. A real image is captured by an image capture device. The image capture device uses a field-of-view lens that distorts the real image. A camera model is applied to the captured real image. The camera model maps objects in the captured real image to an image sensor plane of the image capture device to generate a virtual image. The image sensor plane is reconfigurable to virtually alter a shape of the image sensor plane to a non-planar surface. The virtual image formed on the non-planar image surface of the image sensor is projected to the display device.
-
Citations
34 Claims
-
1. A method of displaying a captured image on a display device comprising the steps of:
-
capturing a real image by an image capture device, the image capture device using a field-of-view lens that distorts the real image; applying a camera model to the captured real image, the camera model mapping objects in the captured real image to an image sensor plane of the image capture device to generate a virtual image, the image sensor plane reconfigured to virtually alter a shape of the image sensor plane to a non-planar surface; and projecting the virtual image formed on the non-planar image surface of the image sensor to the display device; wherein generating the virtual image comprises the steps of; providing a pre-calibrated real camera model by the processor, the real camera model representative of the vision-based imaging device capturing the scene; determining real incident ray angles of each pixel in the captured image based on the pre-calibrated real camera model; identifying an arbitrary shape of the non-planar imaging surface identifying a pose of the virtual camera model; determining virtual incident ray angles of each pixel in the virtual image based on the virtual image model and the non-planar imaging surface; mapping a virtual incident ray to a correlated real incident ray of the real image capture device, wherein rotational compensation is applied to the virtual incident ray angles for correlating the virtual incident ray and the real incident ray if a pose of the virtual camera model is different from a pose of the of the real image capture device; mapping pixels in the virtual image corresponding to coordinates on the non-planar virtual imaging surface to correlated pixels on the real captured image as a function of the correlation mapping between the real incident ray and the virtual incident ray, and wherein a horizontal projection of a virtual incident angle θ
virt is represented by the angle α
, wherein angle α
is represented by the following formula; - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34)
-
Specification