Preparing a panoramic image for presentation

• US 6,593,969 B1
• Filed: 03/08/2000
• Issued: 07/15/2003
• Est. Priority Date: 06/24/1996
• Status: Expired due to Term

• Current Assignee: Cedar Lane Technologies Inc.
• Original Assignee: Be Here Corporation
• Inventors: Morrow, Howard, Lomax, Willard Curtis, Driscoll, Edward Jr., Steinhauer, Alan J.
• Primary Examiner(s): HO, TUAN V
• Application Number:
  US09/521,652
• Time in Patent Office: 1,224 Days
• Field of Search: 348/207,218,220,222,239,333.01,335,340,369,36,37,38,39,143,211.99,211.3,211.8 382/293,294,300,285 359/725,726-731
• US Class Current: 348/335
• CPC Class Codes: G02B 13/06 Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces
• CPC Class Codes: G03B 37/00 Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
• CPC Class Codes: G06T 3/12 Panospheric to cylindrical image transformations
• CPC Class Codes: G08B 13/19626 optical details, e.g. lenses, mirrors or multiple lenses
• CPC Class Codes: G08B 13/19628 of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Most camera systems only record an image from a limited viewing angle. A new panoramic camera apparatus is disclosed that instantaneously captures a 360 degree panoramic image. In the camera device, virtually all of the light that converges on a point in space is captured. Specifically, in the camera of the present invention, light striking this point in space is captured if it comes from any direction, 360 degrees around the point and from angles 50 degrees or more above and below the horizon. The panoramic image is recorded as a two dimensional annular image. Furthermore, various different systems for displaying the panoramic images and distributing the panoramic images. Specifically, methods and apparatus for digitally performing a geometric transformation of the two dimensional annular image into rectangular projections such that the panoramic image can be displayed using conventional methods such as printed images and televised images.

Claims

1. A method for preparing a panoramic image for presentation including steps of:

splitting light that makes up said annular image whereby an annular image is focused on a plurality of image planes;

capturing a plurality of portions of said annular image at said plurality of image planes, each of said plurality of portions being smaller than said annular image;

digitizing said plurality of portions of said annular image;

compositing said plurality of portions of said annular image to produce a digitized annular representation representing an annular representation of a panorama;

geometrically transforming a portion of said digitized annular representation into a digitized planar representation of said portion of said digitized annular representation; and

preparing said digitized planar representation for presentation.

2. The method of claim 1 further including a step of reading said digitized annular representation from a file storage.

3. The method of claim 1 further including a step of presenting said digitized planar representation.

4. The method of claim 1 wherein the step of geometrically transforming said portion is responsive to a viewport control.

5. The method of claim 1 wherein the step of geometrically transforming said portion further includes steps of:

determining a viewing angle;

dynamically changing a dynamically changing sampling shape responsive to said viewing angle; and

sampling said digitized annular representation responsive to said dynamically changing sampling shape.

6. The method of claim 1 wherein the step of geometrically transforming said portion is performed at a local computer.

7. The method of claim 1 wherein the step of geometrically transforming said portion is performed at a remote computer that is in communication with a local computer.

8. The method of claim 1 further including a step of cross calibrating an image variation between some of said plurality of portions of said annular image.

9. An apparatus having a central processing unit (CPU) and a memory coupled to said CPU for preparing a panoramic image for presentation including:

a beam-splitter configured to split light that makes up an annular image whereby said annular image is focused on a plurality of image planes;

an image capture mechanism configured to capture a plurality of portions of said annular image at said plurality of image planes, each of said plurality of portions being smaller than said annular image;

at least one digitizer configured to digitize said plurality of portions of said annular image captured by the image capture mechanism;

a compositing mechanism configured to join said plurality of portions of said annular image to produce a digitized annular representation stored in said memory representing an annular representation of a panorama;

a transformation mechanism configured to geometrically transform a portion of said digitized annular representation in said memory into a digitized planar representation of said portion of said digitized annular representation; and

an image formatting mechanism configured to prepare said digitized planar representation for presentation.

10. The apparatus of claim 9 further including a file system configured to store said digitized annular representation.

11. The apparatus of claim 9 further including a presentation mechanism configured to present said digitized planar representation.

12. The apparatus of claim 9 wherein the transformation mechanism is responsive to a viewport control.

13. The apparatus of claim 9 wherein the transformation mechanism further includes:

a view control mechanism configured to determine a viewing angle;

a shape determination mechanism configured to dynamically change a dynamically changing sampling shape responsive to said viewing angle; and

a sampling mechanism configured to sample said digitized annular representation responsive to said dynamically changing sampling shape.

14. The apparatus of claim 9 further including a cross calibration mechanism configured to cross calibrate an image variation between some of said plurality of portions of said annular image.

15. A computer program product including:

a computer usable storage medium having computer readable code embodied therein for causing a computer to prepare a panoramic image for presentation, said computer comprising a memory, said computer readable code including;

computer readable program code configured to cause said computer to effect a compositing mechanism configured to join a plurality of portions of an annular image to produce a digitized annular representation in said memory representing an annular representation of a panorama, each of said plurality of portions being smaller than said annular image, said plurality of portions of said annular image previously captured and digitized;

computer readable program code configured to cause said computer to effect a transformation mechanism configured to geometrically transform a portion of said digitized annular representation in said memory into a digitized planar representation of said portion of said digitized annular representation; and

computer readable program code configured to cause said computer to effect an image formatting mechanism configured to prepare said digitized planar representation for presentation.

16. The computer program product of claim 15 further including computer readable program code configured to cause said computer to effect a presentation mechanism configured to present said digitized planar representation.

17. The computer program product of claim 15 wherein the transformation mechanism is responsive to a viewport control.

18. The computer program product of claim 15 wherein the transformation mechanism further includes:

computer readable program code configured to cause said computer to effect a view control mechanism configured to determine a viewing angle;

computer readable program code configured to cause said computer to effect a shape determination mechanism configured to dynamically change a dynamically changing sampling shape responsive to said viewing angle; and

computer readable program code configured to cause said computer to effect a sampling mechanism configured to sample said digitized annular representation responsive to said dynamically changing sampling shape.

19. The computer program product of claim 15 further including computer readable program code configured to cause said computer to effect a cross calibration mechanism configured to cross calibrate an image variation between some of said plurality of portions of said annular image.

20. A computer program product including:

a computer data signal embodied in a carrier wave having computer readable code embodied therein for causing a computer to prepare a panoramic image for presentation, said computer comprising a memory, said computer readable code including;

computer readable program code configured to cause said computer to effect a compositing mechanism configured to join a plurality of portions of an annular image to produce a digitized annular representation in said memory representing an annular representation of a panorama, each of said plurality of portions being smaller than said annular image, said plurality of portions of said annular image previously captured and digitized;

computer readable program code configured to cause said computer to effect a transformation mechanism configured to geometrically transform a portion of said digitized annular representation in said memory into a digitized planar representation of said portion of said digitized annular representation; and

computer readable program code configured to cause said computer to effect an image formatting mechanism configured to prepare said digitized planar representation for presentation.