Image-based method and system for building spherical panoramas

• US 6,486,908 B1
• Filed: 05/27/1998
• Issued: 11/26/2002
• Est. Priority Date: 05/27/1998
• Status: Expired due to Term

• Current Assignee: DS2 Tech Incorporated, Transpacific IP Group Limited
• Original Assignee: Industrial Technology Research Institute
• Inventors: Huang, Shu-Cheng, Chen, Ju-Wei, Cheng, Tse
• Primary Examiner(s): DIEP, NHON THANH
• Application Number:
  US09/085,479
• Time in Patent Office: 1,644 Days
• Field of Search: 345/441, 345/419, 345/421, 345/425, 345/427, 345/649, 382/284, 382/154, 382/153, 382/155, 382/156, 382/157, 348/36, 348/39
• US Class Current: 348/39
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 3/047 Fisheye or wide-angle transformations
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/32 using correlation-based methods
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

The invention relates to building spherical panoramas for image-based virtual reality systems. The image-based spherical panoramas can be navigated in any desired view direction (360-degrees) by suitable three-dimensional image browsers or viewers. The method and system also includes computing the number of photographs required to be taken and the azimuth angle of the center point of each photograph for building a spherical environment map representative of the spherical panorama. The method and system also includes an algorithm for computing the accurate azimuth angles of these taken photographs and seaming them together to build the spherical environment map.

Claims

1. A method of transforming a plurality of photographic images of a panoramic scene into a spherical environment map, each photographic image taken at a predetermined sight direction characterized by an elevation angle, the method comprising:

warping each of the plurality of photographic images into a parametric spherical environment map;

image cutting each of the warped photographic images into a rectangular image based on the elevation angle of the sight direction for each of the warped photographic images;

wherein during image cutting, the warped photographic images are cut either horizontally or vertically on the basis of the elevation angle of the sight direction for each of the warped photographic images;

if the elevation angle of the sight direction for a warped photographic image is less than 10 degrees or greater than 170 degrees, the warped photographic image is cut into a rectangular region defined by one horizontal line, which is either a bottom or top edge of the rectangular warped image of the photograph; and

if the elevation angle of the sight direction for a warped photographic image is between 30 degrees and 150 degrees, the warped photographic image is cut into a rectangular region defined by two opposing horizontal lines and two opposing vertical lines.

2. The method of claim 1 wherein warping of each of the plurality of photographic images includes mapping each pixel of the warped photographic image from at least one pixel of an associated photographic image, the attributes of each pixel of the warped photographic image being derived from at least one pixel of the associated photographic image.

3. A system for transforming a plurality of photographic images of a panoramic scene into a spherical environment map, each photographic image taken at a predetermined sight direction characterized by an elevation angle, the system comprising:

a computer-readable medium including;

computer-readable instructions for warping each of the plurality of photographic images into a parametric spherical environment map;

computer-readable instructions for cutting each of the warped photographic images into a rectangular image based on the elevation angle of the sight direction for each of the warped photographic images;

computer instructions for cutting the warped photographic images during image cutting either horizontally or vertically on the basis of the elevation angle of the sight direction for each of the warped photographic images;

computer instructions for;

cutting, if the elevation angle of the sight direction for a warped photographic image is less than 10 degrees or greater than 170 degrees, the warped photographic image into a rectangular region defined by one horizontal line, which is either a bottom or top edge of the rectangular warped image of the photograph; and

cutting, if the elevation angle of the sight direction for a warped photographic image is between 30 degrees and 150 degrees, the warped photographic image into a rectangular region defined by two opposing horizontal lines and two opposing vertical lines.

4. The system of claim 3 wherein the computer instructions for warping each of the plurality of photographic images includes computer instructions for mapping each pixel of the warped photographic image from at least one pixel of an associated photographic image, the attributes of each pixel of the warped photographic image being derived from at least one pixel of the associated photographic image.