Velocity-dependent dewarping of images

• US 6,687,387 B1
• Filed: 12/27/1999
• Issued: 02/03/2004
• Est. Priority Date: 12/27/1999
• Status: Expired due to Term

• Current Assignee: Sony Semiconductor Solutions Corporation (Sony Group Corp.)
• Original Assignee: Internet Pictures, Corporation
• Inventors: Mutz, Andrew H., Molnar, Joseph R. S.
• Primary Examiner(s): Boudreau, Leo
• Assistant Examiner(s): LU, TOM Y
• Application Number:
  US09/472,648
• Time in Patent Office: 1,499 Days
• Field of Search: 345/649, 345/427, 382/107, 382/276, 348/154
• US Class Current: 382/107
• CPC Class Codes: G06T 3/073 Transforming surfaces of revolution to planar images, e.g. cylindrical surfaces to planar images
• CPC Class Codes: G06T 5/80 Geometric correction

Abstract

A method and apparatus are provided for dewarping images. According to one aspect of the present invention, rotational motion of a scene is taken into account for purposes for performing image dewarping. The image is extracted from the scene by selecting pixel values from an environment map that correspond to a viewing plane. Velocity information associated with rotational motion of the scene is determined. Then, based upon the velocity information, a velocity-dependent transformation is determined. Finally, a perspective image is created by applying the velocity-dependent transformation to the image. In this manner, when the images is presented to a user, the appearance of visible and objectionable distortion may be reduced while maintaining the perceived geometric accuracy of the image. For example, when the scene is rotating at a high angular velocity, little or no dewarping may be performed and the image extracted therefrom may be presented essentially uncorrected. In contrast, when the scene is not rotating, the image may be fully corrected. Between these extremes of high angular velocity and no angular velocity, the amount of dewarping may be modulated to intermediate values.

Claims

1. A computer system comprising:

a storage device having stored therein a dewarping routine for transforming an image extracted from a scene into a perspective corrected image;

a processor coupled to the storage device for executing the dewarping routine to generate the perspective corrected image, where;

an appropriate dewarping transformation for correcting distortion in the image is determined as a function of rotational motion of the scene; and

the perspective corrected image is created by applying the appropriate dewarping transformation to the image.

2. The computer system of claim 1, wherein the appropriate dewarping transformation is determined by generating a velocity-dependent transformation based upon the rotational motion of the scene.

3. The computer system of claim 1, wherein the appropriate dewarping transformation is determined by selecting a velocity-dependent transformation from a set of predetermined velocity-dependent transformation matrices based upon the rotational motion of the scene.

4. The computer system of claim 1, wherein the perspective corrected image is left substantially uncorrected when the rotational motion of the scene is within a first predetermined range.

5. The computer system of claim 1, wherein the perspective corrected image is substantially completely corrected when the rotational motion of the scene is within a second predetermined range.

6. A computer system comprising:

a storage device having stored therein an immersive image viewer for allowing a user to navigate an immersive image; and

a processor coupled to the storage device for executing the immersive image viewer to extract an intermediate image representation from a scene, determine a velocity-dependent transformation matrix, perform dewarping processing on the intermediate image representation to create an output image; and

a display coupled to the processor for displaying the output image, where;

the velocity-dependent transformation matrix is determined based upon rotational motion associated with the scene; and

the dewarping processing comprises correcting distortion associated with the intermediate image representation by applying the velocity-dependent transformation matrix to the intermediate image representation.

7. The computer system of claim 6, wherein the scene comprises a 360 degree scene.

8. The computer system of claim 6, wherein the scene comprises a 360×

360 degree scene.

9. The computer system of claim 6, wherein the intermediate image representation comprises a cylindrical environment map.

10. The computer system of claim 6, wherein the intermediate image representation comprises a spherical environment map.