SYSTEM AND METHOD FOR DISPLAYING PANORAMIC IMAGE USING SINGLE LOOK-UP TABLE

• US 20160292821A1
• Filed: 04/04/2016
• Published: 10/06/2016
• Est. Priority Date: 04/03/2015
• Status: Active Grant

• Current Assignee: Electronics and Telecommunications Research Institute, National University of Sciences and Technology
• Original Assignee: Electronics and Telecommunications Research Institute, National University of Sciences and Technology
• Inventors: MURTAZA, Muhammad, SAEED, Saleh, KAKLI, Muhammad Umer, CHO, Yong Ju, SEOK, Joo Myoung, AHN, Sang Woo, CHA, Ji Hun, ALI, Arshad, HAFIZ, Rehan, RASUL, Ashar
• Granted Patent: US 9,870,601 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06T 7/38 Registration of image sequences

Abstract

An apparatus and a method for displaying a panoramic image using a look-up table (LUT) are disclosed, including generating an LUT may include determining first geometric correction information to transform an input domain pixel coordinate system of an input image to a panorama domain pixel coordinate system of a panoramic image, determining second geometric correction information to transform an output domain pixel coordinate system of an output image of the panoramic image to the panorama domain pixel coordinate system of the panoramic image, determining third geometric correction information to transform the output domain pixel coordinate system of the output image to the input domain pixel coordinate system of the input image based on the first geometric correction information and second geometric correction information, and generating an LUT that maps the output domain pixel coordinate system of the output image to the input domain pixel coordinate system of the input image.

Claims

1. A method of generating a look-up table (LUT), comprising:

determining first geometric correction information to transform an input domain pixel coordinate system of an input image to a panorama domain pixel coordinate system of a panoramic image in which a neighboring input image is connected to the input image;

determining second geometric correction information to transform an output domain pixel coordinate system of an output image of the panoramic image output through a plurality of display devices to the panorama domain pixel coordinate system of the panoramic image;

determining third geometric correction information to transform the output domain pixel coordinate system of the output image to the input domain pixel coordinate system of the input image based on the first geometric correction information and the second geometric correction information; and

generating an LUT that maps the output domain pixel coordinate system of the output image to the input domain pixel coordinate system of the input image based on the third geometric correction information.

2. The method of claim 1, wherein the determining of the third geometric correction information comprises:

determining the third geometric correction information by combining inversely transformed first geometric correction information and the second geometric correction information.

3. The method of claim 1, wherein the determining of the second geometric correction information comprises:

setting the output domain pixel coordinate system of the output image to be the panorama domain pixel coordinate system of the panoramic image, in response to the display devices corresponding to a multi-panel environment.

4. The method of claim 1, wherein the generating of the LUT comprises:

determining an input domain pixel coordinate system of an input image corresponding to an output domain pixel coordinate system of an output image using at least one of Bezier correction, a homography matrix among cameras capturing the input image, a homography matrix between output domain pixel coordinates of the output image and panorama domain pixel coordinates of a panoramic image, and rotational transformation; and

generating the LUT by mapping the determined input domain pixel coordinate system of the input image to the output domain pixel coordinate system of the output image.

5. A method of outputting a panoramic image, comprising:

applying, to an input image, a first blending mask determined based on an overlapping area between the input image and another input image in a panoramic image in which the input image is connected to the another input image;

transforming, to an output image, the input image to which the first blending mask is applied using a look-up table (LUT) that maps an input domain pixel coordinate system of the input image to an output domain pixel coordinate system of an output image output through a plurality of display devices;

applying, to the output image, a second blending mask determined based on an overlapping area in the panoramic image output through the display devices; and

outputting the output image to which the second blending mask is applied.

6. The method of claim 5, further comprising:

applying a color correction parameter to the input image to which the first blending mask is applied, and

wherein the transforming comprises;

transforming, to the output image, the input image to which the color correction parameter is applied using the LUT.

7. The method of claim 5, wherein the LUT is generated based on third geometric correction information to transform the output domain pixel coordinate system of the output image to the input domain pixel coordinate system of the input image.

8. The method of claim 7, wherein the third geometric correction information is generated based on first geometric correction information to transform the input domain pixel coordinate system of the input image to a panorama domain pixel coordinate system of the panoramic image and on second geometric correction information to transform the output domain pixel coordinate system of the output image to the panorama domain pixel coordinate system of the panoramic image.

9. The method of claim 7, wherein, in response to the display devices corresponding to a multi-panel environment, the second geometric correction information is used to correct the output domain pixel coordinate system of the output image to be identical to the panorama domain pixel coordinate system of the panoramic image.

10. The method of claim 5, wherein the LUT is generated by mapping, to the output domain pixel coordinate system of the output image, an input domain pixel coordinate system of an input image determined using at least one of Bezier correction, a homography matrix among cameras capturing the input image, a homography matrix between output domain pixel coordinates of the output image and panorama domain pixel coordinates of the panoramic image, and rotational transformation.

11. An apparatus for generating a look-up table (LUT), comprising:

a processor configured to determine third geometric correction information to transform an output domain pixel coordinate system of an output image to an input domain pixel coordinate system of an input image based on first geometric correction information to transform the input domain pixel coordinate system of the input image to a panorama domain pixel coordinate system of a panoramic image in which a neighboring input image is connected to the input image and on second geometric correction information to transform the output domain pixel coordinate system of the output image of the panoramic image output through a plurality of display devices to the panorama domain pixel coordinate system of the panoramic image, and

generate an LUT that maps the output domain pixel coordinate system of the output image to the input domain pixel coordinate system of the input image based on the third geometric correction information.

12. The apparatus of claim 11, wherein the processor is configured to determine the third geometric correction information by combining inversely transformed first geometric correction information and the second geometric correction information.

13. The apparatus of claim 11, wherein, in response to the display devices corresponding to a multi-panel environment, the processor is configured to determine the second geometric correction information to set the output domain pixel coordinate system of the output image to be the panorama domain pixel coordinate system of the panoramic image.

14. The apparatus of claim 11, wherein the processor is configured to generate the LUT by determining an input domain pixel coordinate system of an input image corresponding to an output domain pixel coordinate system of an output image using at least one of Bezier correction, a homography matrix among cameras capturing the input image, a homography matrix between output domain pixel coordinates of the output image and panorama domain pixel coordinates of the panoramic image, and rotational transformation, and by mapping the determined input domain pixel coordinate system of the input image to the output domain pixel coordinate system of the output image.